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PREFACE 

In  the  first  chapter  of  this  book  I  endeavor  to  establish  that  a 
method  of  proving  the  independence  of  two  or  more  mental  traits 
or  capacities  lies  at  the  root  of  a  comprehensive  study  of  mental 
organization.  My  connection  with  the  development  of  a  technique 
to  accomplish  this  end  extends  back  in  time  more  than  a  decade. 
The  problem  readily  grew  out  of  an  interest  in  guidance  and  in 
the  inter-correlation  of  mental  abilities.  The  work  of  Thorndike 
along  these  lines  was  an  early  and  potent  influence,  while  the  early 
and  late  work  of  Spearman  has  always  been  most  intimate  in  its 
essential  purpose  and  in  its  techniques. 

Incidentally  not  a  few  of  the  findings  of  my  study,  which  it 
was  thought  would  be  new,  are  foreshadowed  or  specifically  cited 
in  Spearman's  last  work,  The  Abilities  of  Man  (1927).  This  is 
really  most  fortunate,  for  it  lays  the  foundation  for  future  work 
with  the  promise  of  fruitful  outcome  not  possible  without  such 
corroboration.  The  experimental  determination  of  mental  types 
would  provide  a  basis  for  psychology  which  unfortunately  is  now 
quite  lacking.  The  essential  requisite  is  a  technique  for  testing  the 
agreement  of  any  postulation  of  independent  mental  traits  with 
observed  facts.  In  my  judgment,  the  chief  claim  to  merit  of  the 
present  study  lies  in  its  bearing  upon  procedure  even  more  than  in 
its  specific  findings,  however  intimate  these  may  be  with  the  im- 
mediate problems  of  guidance  and  individual  differences. 

I  am  indebted  to  Dr.  E.  P.  Cubberley,  Dean  of  the  School  of 
Education  with  which  I  am  connected,  for  encouragement  and 
facilities  for  the  conduct  of  this  study,  and  to  the  Commonwealth 
Fund  for  general  financial  assistance  and  for  a  fellowship,  which 
was  very  ably  filled  by  Mr.  C.  R.  Brolyer.  Chapter  ix  is  a  study  of 
data  found  in  published  sources.  As  there  noted,  various  students 
have  been  responsible  for  carrying  through  the  statistical  and  in- 
terpretative work  leading  to  certain  of  these  analyses. 

Truman  L.  Kelley 
Stanford  University,  California 
December  15,  1927 
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CROSSROADS  IN  THE  MIND  OF  MAN 

CHAPTER  I 

THE  BOUNDARIES  OF  MENTAL  LIFE  AND  A  TECH- 
NIQUE FOR  THEIR  INVESTIGATION 

The  study  of  the  nature  and  scope  of  mental  traits  is  as  broad 
as  the  entire  field  of  psychology,  and  just  about  as  evasive  as  the 
all-pervasive  ether.  He  who  dedicates  his  services  to  "human  wel- 
fare" is  rather  less  likely  to  ease  the  progress  of  mankind  than, 
say,  an  ear  doctor  who  limits  his  attention  to  a  narrower  field. 
Nevertheless  it  is  necessary  to  envisage  an  entire  realm  in  order 
to  maintain  a  proper  perspective,  to  keep  poised  in  the  turmoil  of 
separate  schools,  neo-schools,  and  counter-schools.  Each  separate 
school  is  generally  willing  to  ignore  the  others  with  the  fine  toler- 
ance of  the  wise  toward  the  harmlessly  demented.  If  perchance  a 
behaviorist  takes  issue  with  a  psychoanalyst,  the  latter  blandly 
informs  him  that  he  does  not  know  the  facts  and  the  principles  of 
the  latter's  study,  and  in  this  he  is  probably  right.  How,  then,  as 
each  school  becomes  more  specialized  in  technique,  more  confined 
within  its  self-made  walls,  and  more  dependent  upon  the  rapidly 
increasing  fruits  of  its  own  garden,  is  there  any  chance  for  helpful 
criticism  of  school  by  school,  or  any  prospect  of  co-ordination  of 
their  several  doctrines?  Not  only  is  there  prospect,  but  sooner  or 
later  co-ordination  is  inevitable,  for  the  doctrines  meet  at  the  cross- 
roads of  life.  Professor  Blank  found  bluejays  breaking  the  eggs 
in  a  quail's  nest,  and  killed  seven  in  as  many  shots.  He  was  "so 
mad  that  he  couldn't  miss."  What  a  fine  interplay  of  traits !  Usu- 
ally emotions  and  motor  co-ordinations  run  separate  courses,  but 
here  they  met  at  the  quail's  nest. 

It  would  seem  that  just  two  things  are  necessary  to  a  com- 
parative and  co-ordinative  study :  First,  a  technique  that  is  uni- 
versal in  its  applicability  in  the  sense  that  it  serves  not  only  at  the 
crossroads,  but  along  the  remote  stretches  where  no  other  highway 
is  near.    And,  second,  the  will  and  the  opportunity  on  the  part  of 
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someone  to  apply  this  technique  to  the  divergent  and  convergent 
paths  of  modern  psychology.  The  technique  that  is  necessary  is 
to  be  merely  deductive,  for  its  object  is  to  test  the  validity  of  claims 
made  and  supported  by  sundry  schools,  and  it  is  not  primarily 
interested  in  the  way  these  various  claims  happen  to  have  been 
conceived  in  the  first  instance. 

This  single  method  of  valuation  applies  to  all  schools  of  psy- 
chology, because  in  one  important  regard  they  all  do  the  same 
thing,  in  that  each  advances  certain  psychological  elements  as 
underlying  its  particular  system — the  behaviorist  has  his  original 
tendencies  and  "given"  nervous  structure,  the  gestalt  psychologist 
his  configurations  and  e  pluribus  unitm  doctrine,  the  Freudian  his 
underlying  sexual  urges,  and  so  on.  Without  expressly  so  stating, 
the  very  postulation  of  these  different  elements  constitutes  a  claim 
that  each  is  an  entity  in  itself  and  is  entitled  to  an  independent 
status  in  the  field  of  mental  life.  Thus  all  that  is  needed  in  the 
way  of  technique  by  him  who  would  investigate  the  entire  field  is 
a  device  for  testing  the  independence  of  any  given  element  from 
all  others  or  at  least  from  such  as  may  be  thought  to  be  somewhat 
similar  to  it. 

Before  such  testing  there  must  be  a  definition  of  the  element, 
and  the  school  of  psychology  in  question  is  obligated  to  supply  this. 
This  definition  must  be  invariable,  and  expressible  in  terms  of  con- 
duct. Certainly  it  would  be  in  reason  to  demand  as  much  in  any 
other  field.  If  a  certain  doctor  maintains  that  hives  are  caused  in 
one  person  by  tomatoes,  in  some  other  individual  by  any  sort  of 
protein,  and  in  a  third  person  by  some  particular  protein,  unless 
caused  by  the  lack  of  some  protein,  his  very  comprehensive  formu- 
lation is  not  subject  to  experimental  test.  About  all  that  can  be 
done  with  such  a  formulation,  whether  in  psychology,  medicine, 
astrology,  economics,  or  any  other  department  of  human  activity 
is  to  let  it  alone  and  see  that  it  does  not  intrude  upon  more  promis- 
ing hypotheses. 

The  multiplicity  of  causes  put  forward  by  certain  psychoana- 
lysts for  a  single  outcome  nearly  precludes  the  subjection  of  their 
claims  to  scientific  inquiry.    If  it  is  claimed  that  one  performance 
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is  consequent  to  one  certain  capacity,  the  matter  may  be  readily 
tested.  Even  if  the  performance  is  a  compound  of  two  capacities 
check-up  is  possible.  As  the  number  of  possible  causes  increases 
to  three,  four,  or  more,  the  possibility  of  check-up  rapidly  vanishes, 
and  science  goes  through  pseudo-science  to  speculation  or  to  char- 
latanry. The  trouble  is  not  primarily  in  postulating"  several  con- 
tributing causes  but  in  doing  this  antecedent  to  the  development  of 
a  method  of  proof.  In  any  true  science  the  formulation  and  the 
means  of  at  least  partial  verification,  generally  by  noting  necessary 
objective  consequences,  run  hand  in  hand. 

Thus,  in  the  field  of  psychology,  if  a  designation  of  some  trait 
or  capacity,  as  a  category  of  mental  life,  is  to  be  given  serious  con- 
sideration, it  must  be  such  as  to  reveal  itself  as  a  measurable  differ- 
ence in  conduct,  that  is,  as  a  measurable  difference  in  the  same 
individual  at  different  times,  or  in  different  individuals  at  the  same 
time.  Does  a  trait  like  introversion  meet  these  conditions?  The 
number  of  different  verbal  statements  of  the  meaning  to  be  at- 
tached to  this  term  falls  but  a  little  short  of  the  number  of  people 
using  it  in  writing.  Many  of  these  meanings  are  so  subjective  as 
to  lead  one  to  doubt  whether  differences  of  conduct  can  be  related 
to  them.  No  method  of  verification  can  be  hoped  for  or  in  fact 
desired  that  will  investigate  the  reality  of  so  indefinite  a  concept. 
If  one  or  more  of  the  users  of  the  term  state  that  they  mean 
thereby  high  scoring  on  a  designated  test  which  is  definite,  admin- 
istered in  a  standardized  manner,  and  which  yields  an  objective 
score,  then,  and  practically  only  then,  can  the  matter  be  subjected 
to  test. 

This  demand  that  a  concept  be  subjected  to  objective  measure- 
ment before  it  is  worthy  of  serious  consideration  as  an  independent 
category  of  mental  life,  though  sweeping,  is  not  too  sweeping,  if 
we  limit  objective  measurements  to  such  as  are  definable  and  veri- 
fiable. How  about  the  large  class  of  concepts  which  are  definable 
only  in  a  rough  way  and  verifiable  only  in  part  ?  Suppose  we  define 
"honesty"  in  the  following  manner :  "It  is  a  trait  possessed  in 
varying  amounts  by  school  children  and  recognized  by  teachers, 
with  the  result  that  when  teachers  rank  their  pupils  on  the  basis  of 
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honesty,  a  measure  of  the  trait  is  obtained."  Let  us  first  note  that 
in  this  statement  no  precise  distinction  has  been  made  between 
honesty  itself  and  the  measure  of  it.  To  determine  whether  such  a 
lack  of  distinction  is  justified  we  should  attempt  to  verify  the 
measure.  If  a  second  equally  trustworthy  teacher  having  equal 
familiarity  with  certain  pupils  gives  a  rank  order  which  is  the  same 
as  a  first  teacher's,  and  if  a  third  teacher,  a  fourth  teacher,  etc.,  all 
do  the  same,  then  the  measure  is  verified  and  there  is  no  need  of 
distinction  between  the  trait  and  the  measure  of  it.  Such  a  situ- 
ation would  arise  in  practice  if  height  instead  of  honesty  were  the 
trait  in  question.  We  say,  "John  is  four  feet  eight  inches  tall,"  and 
do  not  quibble  over  the  fact  that  "four  feet  eight  inches"  is  merely 
some  person's  measurement  of  John.  If  there  is  complete  agree- 
ment the  measurement  is  the  trait  for  all  practical  purposes.  In  the 
case  of  honesty  there  would  be  no  complete  agreement  but  partial 
agreement  only.  Does  such  a  measure  provide  a  basis  for  scientific 
investigation?  It  seems  to  the  writer  that  it  does,  provided  (1)  the 
degree  of  agreement  of  a  measure  in  hand  with  a  second  equally 
trustworthy  measure  is  known,  (2)  the  technique  adopted  takes 
the  unreliability  of  the  measure  into  account  and  allows  for  it  so 
that  no  systematic  error  is  introduced,  and  (3)  the  technique 
adopted  guards,  by  drawing  tentative  conclusions  where  necessary, 
against  any  chance  error  which  may  be  introduced  due  to  this  un- 
reliability of  the  measure. 

These  are  necessary  qualifications,  but  when  these  precautions 
are  taken  it  would  seem  that  objective  measures  in  the  sense  earlier 
insisted  upon  may  be  derived  from  sources  no  more  specific  than 
the  judgments  of  acquaintances.  Though  this  is  true,  it  is  surely 
the  part  of  wisdom  to  utilize  performance  records  which  are  inde- 
pendent, or  nearly  independent,  of  human  judgments  whenever 
possible  and  when  dealing  with  the  more  far-reaching  issues. 

Some  very  suggestive  studies  of  mental  capacity  based  upon 
judgments  have  been  made.  The  following  may  be  mentioned  as 
of  special  value:  Shen,  "The  Validity  of  Self-Estimate"  (1925), 
"The  Reliability  and  Correlation  of  Personal  Ratings  on  Certain 
Traits"    (1924);   Webb,   "Character  and   Intelligence"    (1915); 
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Magson,  "How  We  Judge  Intelligence"  (1926)  ;  Thorndike,  Breg- 
man,  and  Cobb,  "The  Selection  of  Tasks  of  Equal  Difficulty  by  a 
Consensus  of  Opinion"  (1924)  ;  and  Thorndike,  "A  Constant  Er- 
ror in  Psychological  Ratings"  (1920).1  After  exercising  all  pos- 
sible care  there  remain  ambiguities  in  the  interpretation  of  judg- 
ment measures.  Should  ten,  twenty,  or  even  one  hundred  ac- 
quaintances give  judgments,  which,  pooled,  characterize  a  person 
as  one  standard  deviation  above  the  average  for  his  age,  in  honesty, 
still  no  one  knows  just  what  is  meant  by  them,  and  probably  never 
can  know,  for  he  has  no  way  of  discovering  how  his  independent 
concept  agrees  or  disagrees  with  the  average  concept  of  these 
judges.  On  the  other  hand,  if  honesty  is  defined  as  a  trait  tending 
toward  higher  scores  on  a  designated  test,  when  administered  and 
scored  as  directed,  then  any  particular  student  can  study  the  rela- 
tionships of  this  "honesty,"  even  though  he  might  individually  mis- 
interpret the  purport  of  the  test  questions. 

A  few  years  ago  Garnett  (1919)  made  an  analysis  of  Webb's 
(1915)  study  based  upon  judgments,  and  concluded  that  there  is 
a  mental  factor  "cleverness."  Certainly  to  understand  this,  "clever- 
ness" is  to  be  interpreted  as  by  Garnett,  but  this  we  can  only  ap- 
proximate. And  further,  Garnett  deduced  his  "cleverness"  from 
"quickness,"  "profoundness,"  "common  sense,"  "originality,"  etc. 
(of  48  mental  traits  investigated,  43  came  from  judgments),  which 
were  traits  appraised  by  Webb's  judges.  The  meaning  of  these 
traits  is  certainly  to  be  interpreted  as  by  the  average  of  Webb's 
judges,  but  as  to  these  meanings  both  we  and  Garnett  can  secure 
only  rough  approximations,  so  that  our  final  belief  in  "cleverness" 
as  a  factor  must  be  most  uncertain.  Still  more  serious  is  the  fact 
that  it  is  incapable  of  verification,  for  we  cannot  duplicate  by  re- 
production of  the  investigation,  step  by  step,  our  own  interpretation 
of  Garnett's  interpretation  of  Webb's  judges'  interpretation  of  the 
traits  of  the  unknown  subjects.    All  these  difficulties  except  the 


1  For  bibliographical  details,  see  Bibliography  following  chapter  x  below. 
References  will  hereafter  be  given  to  that  list,  by  author,  year,  and,  when 
necessary,  key  word. 
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last — differences  in  supposedly  similar  populations — are  avoided 
when  a  trait  is  denned  in  terms  of  an  objective  measure  which  is 
capable  of  being  duplicated  and  thus  verified. 

Because  of  the  uncertainty  of  outcome  when  dealing  with 
judgments  in  a  study,  the  purpose  of  which  is  to  determine  dis- 
parate mental  rubrics,  this  type  of  psychological  investigation  is 
only  incidentally  investigated  in  connection  with  the  delightful 
study  by  Shen  (see  chapter  x  below).  It  is  probably  an  important 
and  legitimate  field  in  the  matter  of  discovery  and  preliminary 
survey,  but  it  is  truly  of  doubtful  value  in  the  subsequent  steps  of 
proof. 

Definition  and  reproducibility  are  essential  characteristics  of 
the  psychological  data  to  be  dealt  with.  Having  data  with  these 
characteristics,  and  having  purposes  as  unified  as  is  the  case  with 
investigators,  there  is  provided  a  situation  which  is  amenable  to  a 
single  type  of  analysis.  The  avowed  purposes  of  psychologists 
sound  quite  different,  but  this  need  not  deter  us  from  approaching 
all  investigations  with  a  single  comparative  technique,  because 
there  is  a  fundamental  underlying  unity  in  these  purposes.  The 
determination  of  some  difference  is  the  object  of  every  psycho- 
logical formulation.  For  convenience  these  differences  may  be 
characterized  as  of  three  types,  or  of  some  composite  of  the  three. 
Thus  the  difference  may  be  chiefly  affected  by  a  change  in  time, 
as  in  the  case  of  growth  and  fatigue,  chiefly  affected  by  spatial 
consideration,  as  are  all  of  our  sensory  and  motor  functions,  or 
chiefly  related  to  differences  in  type  of  central  nervous  activity, 
as  are  the  emotions  and  the  several  intellectual  modes  of  thought, 
reasoning,  memorizing,  etc. 

The  technique  of  Spearman  based  upon  tetrad  differences  (see 
page  47),  for  determining  the  discreteness  of  mental  phenomena, 
and  that  used  by  the  writer,  involving  much  of  Spearman's  tech- 
nique but  also  a  considerable  extension  of  it,  is  entirely  adequate 
to  determine  whether  two  things,  say  a  set  of  visual  and  a  set  of 
auditory  measures,  are  basically  the  same  or  different.  The  case 
cited  is  so  simple  that  its  solution  seems  obvious.  Much  simpler 
devices  than  tetrad  differences  are  available  here,  as  perhaps  in 
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the  case  of  all  differences  affected  by  spatial  considerations,  which 
enable  one  to  establish  that  the  auditory  and  visual  phenomena  are 
disparate.  It  would  be  ridiculous  to  measure  both  the  visual  and 
the  auditory  acuity  of  a  large  number  of  people,  measure  still  other 
traits,  and  then  calculate  a  lot  of  tetrad  differences  to  see  if  they 
would  warrant  the  conclusion  that  visual  and  auditory  acuities  are 
different  things.  Also,  dealing  with  a  single  individual,  it  would 
be  absurd  to  measure  the  sensitivity  to  light,  to  sound,  to  heat, 
etc.,  of  different  areas  of  the  body  surface,  calculate  tetrad  dif- 
ferences and  conclude  that  visual  and  the  other  sensitivities  are 
not  the  same.  However,  this  could  be  done,  and  by  this  technique 
each  measurable  sensory  and  motor  trait  of  mankind  that  does 
stand  alone  could  be  so  proved.  We  thus  see  that  the  technique  in 
question  is  much  broader  in  its  applicability  than  one  might  judge 
from  the  field  to  which  it  has  been  applied.  However  ponderous 
the  tetrad-difference  method  is  in  the  case  of  these  sensory  and 
motor  traits,  it  seems  to  be  the  only  way,  other  than  that  of  intro- 
spection, available  in  connection  with  purely  mental  phenomena. 
Apparently  the  reason  is  that  the  usual  concomitants  of  sensory 
and  motor  traits,  namely,  space  and  time,  are  not  conditions  of 
mental  life.  One's  reasoning  power  has  not  been  localized  in  any 
particular  end  organ,  and  it  is  approximately  timeless,  operating 
with  equal  facility  yesterday,  today,  and  tomorrow.  Mental  phe- 
nomena are  not  entirely  devoid  of  temporal  characteristics,  as  will 
be  discussed  at  greater  length  in  connection  with  growth,  but  in 
so  far  as  they  are  independent  of  it  they  are  not  amenable  to  study 
by  the  simple  procedures  which  suffice  with  sensory  and  motor 
traits. 

We  may  characterize  the  entire  realm  of  psychological  thought 
by  saying  that  it  is  concerned  (a)  with  differentiating  between 
traits,  or  more  broadly,  though  without  a  change  in  meaning,  with 
studying  the  relationship  between  traits;  (b)  with  determining 
changes  in  single  traits  (growth,  fatigue)  as  time  changes;  and 
(c)  with  modification  as  locus  (end-organ)  changes.  From  a  dif- 
ferent point  of  view,  the  first  of  these  is  to  be  recognized  as  a 
study  of  individual  differences.    Of  these  three  problems  of  dif- 


8  CROSSROADS  IN  THE  MIND  OF  MAN 

ference,  we  are  here  concerned  only  with  the  first,  for  a  trait  must 
be  determined  as  independent  before  it  is  very  useful  to  attempt 
to  determine  its  growth,  if  it  does  grow,  or  its  locale,  if  it  has  one. 
Further,  as  to  differentiating  between  traits  we  are  here  concerned 
only  with  those  the  independent  status  of  which  is  open  to  question 
— memory,  analysis,  persistence,  etc.,  but  not  visual  acuity,  right- 
hand  grip,  etc. 

Though  our  field  is  thus  limited,  it  may  not  be  amiss  to  attempt 
to  picture  the  structure  of  a  human  organism  which  is  possessed 
of  traits  as  wide  apart  as  those  of  mankind.  Dr.  John  F.  Walker 
found  (1924)  that  there  are  many  independent  motor  and  sensory 
capacities  in  children,  thus  suggesting  specific  independently  con- 
ditioned origins.  Professor  Spearman  (1927,  Abilities,  p.  217) 
reports  much  the  same  thing.  Accordingly,  so  far  as  these  things 
are  concerned  we  may  look  to  a  rich  and  varied  original  genetic 
structure.  The  writer  has  argued  elsewhere  (1926,  Influence; 
1926,  "Oddities")  that  this  many-particled  original  nature  is  lim- 
ited in  its  development  by  environmental  pressure.  If  there  are  40 
chromosones,  each  with  1,000  genetic  elements,  and  if  there  are 
five  allelomorphic  alternates  for  each  element,  then  the  number  of 
permutations  conceivable  is  540xl00°.  The  earth  could  thus  be  popu- 
lated millions  of  times  without  duplicating  in  genetic  structure 
any  individual.  However,  probably  many  of  these  permutations 
are  lethal,  for  the  embryo  in  the  main  develops  in  one  certain 
milieu  only.  Certainly  medical  science  indicates  a  wonderful  simi- 
larity in  metabolism  and  tolerance,  both  in  infants  and  in  older 
people.  If  we  carry  this  thought  a  step  farther  we  can  well  be- 
lieve that  in  the  case  of  traits  concerned  with  social  contacts  (love, 
hate,  mental  agility  at  argument,  intellectual  keenness  in  finding 
one's  way,  subtlety  in  conflict,  tolerance  toward  the  views  of  asso- 
ciates, etc.),  certain  permutations  only  are  favorable  to  survival. 
Perhaps  through  generations  the  allelomorphic  elements  in  these 
surviving  combinations  have  become  linked  through  mechanisms 
not  unlike  those  of  symbiosis.  Thus  genetic  origins  almost  in- 
finitely extensive,  interacting  with  physiological  and  social  environ- 
ment, find  their  fruition  in  beings  running  more  or  less  true  to 
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survival  types  in  essential  mental  and  physical  make-up,  but  of  great 
variability  in  nonessential  physiological  detail.  To  illustrate,  we 
might  readily  conceive  of  almost  an  infinite  number  of  intergrades 
in  the  matter  of  sex ;  but  conditions  of  survival  have  determined 
that  most  of  these  must  vanish,  so  that  as  a  final  result  male  and 
female  children  are  born  and  few  hermaphrodites.  This  picture2 
of  genetic  structure,  though  merely  a  picture,  seems  adequate  to 
a  portrayal  of  all  the  conditions  of  inter-relationship  found,  while 
it  is  at  the  same  time  not  sufficiently  specific  to  prejudice  any  of 
the  experimental  treatment.  It  has  two  important  features  in 
addition  to  those  mentioned,  in  that  it  suggests  in  what  evolution 
consists  and  it  gives  a  definite  place  to  both  heredity  and  environ- 
ment in  this  process. 

We  have  noted  that  mental  traits  which  we  wish  to  study  with 
a  view  to  differentiating  between  them  are  of  the  class  not  readily 
localized  in  space  and  time.  Even  so  the  field  is  very  extensive 
and  includes  what  are  commonly  called  the  higher  mental  processes. 
Our  problem  is  difficult  because  of  the  complexity  of  these  proc- 
esses and  because  of  their  number,  for  they  cannot  be  studied 
singly.  A  single  mental  trait  can  be  studied  with  reference  to 
growth  without  any  attention  to  other  traits,  but  obviously  when 


2  The  conclusions  of  Stewart  in  his  "Mendelism  in  Bacteriology"  (1926), 
as  reported  by  E.  F.  Symmes  (Psychological  Abstracts,  Vol.  1,  No.  5,  May 
1927,  Item  No.  1111),  are  very  pertinent  in  this  connection:  "The  variations 
exhibited  occur  only  in  adaptation  to  the  stimulus  presented,  this  fact  estab- 
lishing an  important  hypothesis  for  evolutionary  theory — that  a  race  can 
adapt  itself  by  variation  directly  to  its  environment  and  that  such  an  adapta- 
tion is  rigorously  inherited.  Such  an  acquired  character,  however,  is  inherited 
only  by  unicellular  organisms  ;  in  higher  forms  it  doubtless  would  affect  the 
soma  only,  and  not  the  germ-plasm,  and  therefore  not  be  inherited."  This  is 
quoted  because  so  far  as  unicellular  organisms  are  concerned  it  very  fully 
supports  the  hypothesis  here  mentioned.  So  far  as  higher  forms  of  life  are 
involved  it  need  not  be  considered  a  reversal  of  Mendelian  doctrine  to  postu- 
late some  functional  relationship  between  environmental  influences  and  link- 
age of  the  genetic  elements  possessed  by  surviving  individuals,  thus  in  fact 
giving  hereditary  conditions  operating,  though  much  more  slowly,  as  in  the 
case  of  the  bacteria  studied  by  Stewart. 
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the  issue  is  the  difference  between  traits,  it  must  be  studied  in 
conjunction  with  other  traits. 

It  is  here  argued  that  such  an  approach  should  logically  precede 
all  detailed  studies  of  a  trait.  Professor  Spearman  argues  that 
"perseveration,"  as  measured  by  G.  E.  Miiller,  is  the  same  as 
"introversion,"  as  proposed  by  Jung.  Surely  so  vital  an  issue  as 
this  could  well  be  made  a  matter  of  first  importance,  even  if  the 
investigator  is  studying  merely  the  one  or  the  other  trait,  and  not 
primarily  trying  to  see  things  in  proper  perspective.  If  this  latter 
is  the  object,  then  not  only  should  introversion  and  perseveration 
be  studied  together,  but  also  along  with  many  other  traits,  of  which 
some  will  probably  be  related  to  these  two  and  some  will  be  en- 
tirely independent.  A  comprehensive  study  of  this  last  sort  has 
never  been  made.  The  experimental  work  of  the  present  volume 
has  dealt  jointly  with  general  ability  (probably,  in  the  main,  ma- 
turity), manipulation  of  spatial  relationships,  facility  with  num- 
bers, facility  with  verbal  material,  memory,  mental  speed,  and 
certain  other  less  clearly  denned  traits.  Professor  Spearman  and 
his  students  have  studied  these  same  abilities,  except  facility  with 
verbal  material  as  here  defined,  and  other  traits,  but  his  studies 
have  not  been  of  all  the  traits  at  once.  Generally  speaking  they 
have  been  investigations  of  the  independence  of  each  of  the  traits 
singly,  from  Spearman's  general  factor  "g."  These  studies  have 
been  most  fruitful  in  indicating  real  differences  between  certain 
traits  and  certain  g's  (the  writer  does  not  quite  subscribe  to  the 
view  that  the  thing  called  "g"  in  all  of  these  investigations  is  the 
same  throughout),  and  in  suggesting  differences  between  these; 
but  the  much-needed  comprehensive  examination  of  relationships 
between  many  differently  labeled,  derived,  measured,  and  variously 
sponsored  mental  traits  is  still  to  be  made.  Certainly  such  an  in- 
vestigation should  take  into  consideration  the  following  factors : 
(a)  maturity;  (b)  sex;  (c)  race;  (d)  manipulation  of  spatial 
relationships  in  so  far  as  independent  of  differences  in  visual 
acuity,  etc.;  (e)  manipulation  of  auditory  relationships  in  so  far 
as  independent  of  auditory  acuity,  etc.;  (/)  verbal  facility;  (g) 
number   facility;    (//)    memory — one  or  more  kinds;    (/)    mental 
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speed ;  (/)  one  or  more  traits  involving"  general  motor  organization 
and  skill;  (k)  purpose  or  purposes;  (/)  ebullience  or  cleverness; 
(m)  perseveration  or  intro-extraversion ;  (w)  oscillation  or  vari- 
ability in  performance;  (o)  one  or  more  traits  connected  with 
social  interest  and  activities;  (p)  any  remaining  general  factor  not 
included  in  the  preceding.  The  only  adequate  attack  is  to  study 
all  of  these  at  once  upon  the  same  population,  as  otherwise  certain 
relationships,  perhaps  of  great  importance,  will  be  missed.  Owing 
to  previous  work,  mainly  that  of  Spearman,  the  list  as  drawn  up  is 
very  select  and  very  promising  for  future  study.  The  writer  be- 
lieves that  the  techniques  herein  employed  are  adequate  for  such 
a  study  and  rather  more  comprehensive  than  those  of  Spearman, 
in  spite  of  the  fact  that  Spearman's  have  already  yielded  rich 
return. 

In  the  study  of  independent  mental  capacities,  Spearman  has  in 
the  past  utilized  quite  a  number  of  different  criteria.  Though  he 
claims  that  these  early  criteria  are  sound,  because  in  harmony  with 
results  based  upon  what  he  now  considers  his  final  technique,  there 
is  considerable  room  for  argument.  If  Technique  B  is  sound  and 
leads  to  a  certain  conclusion,  then  it  does  not  follow  that  Technique 
A  is  sound  because  in  some  given  instance  it  leads  to  the  same 
conclusion.  We  are,  however,  not  concerned  at  this  time  with 
Spearman's  earlier  techniques.  His  last  one,  for  which  he  claims 
finality  and  universality,  must  be  carefully  scrutinized. 

It  is  readily  shown  that  if  four  variables  have  one,  and  only 
one,  common  factor  running  through  them  (in,  the  writer  would 
add,  a  linear  manner)  then  every  tetrad  difference  involving  the 
correlation  coefficients  of  these  four  variables  will  be  equal  to 
zero.  In  the  notation  of  this  text,  tetrad  differences  are  denoted 
by  the  letter  t  with  appropriate  subscripts,  and  are  defined  as 
follows :  ■s 

'12  34  ^12  ^34  ^13  ^24 

'l  2  4  3  =  ^12  ^34  **14  ^23  f" L      J 

*1  3  4  2  =  ^13  ^24  ^14  ^23  J 

The  equality  of  these  tetrads  to  zero  in  the  case  when  one  general 
factor  is   sufficient  was  first  pointed  out  by   Spearman.     It   is 
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very  easily  proved  in  a  number  of  ways,  one  of  which  is  given  in 
chapter  iii. 

If  there  are  more  than  four  variables,  if  one  general  factor  only 
runs  through  the  variables,  and  if  they  contain  no  group  fac- 
tor, i.e.,  a  factor  found  in  a  number  of  the  variables  but  not  all  of 
them,  then  every  tetrad  will  equal  zero.  The  converse  of  this  is 
also  readily  proved,  namely,  if  every  tetrad  does  equal  zero,  then 
the  variables  may  be  thought  of  as  having  one  general  factor  and 
no  group  factors.  With  this  as  a  starting-point  Spearman  argues 
that  if  the  distribution  of  obtained  tetrad  differences  shows  a 
variability  no  greater  than  would  be  expected  as  a  matter  of 
chance,  then  one  and  only  one  factor,  other  than  factors  specific 
to  the  separate  variables,  may  be  looked  for  in  the  several  measures. 
To  carry  this  argument  into  effect  the  distribution  of  tetrads  must 
be  made  (based  on  all  the  possible  tetrads  resulting  from  the 
variables  employed),  and  its  standard  deviation  must  be  calculated 
and  compared  with  the  theoretical  standard  deviation  in  case  all 
tetrads  deviate  from  zero  merely  as  a  matter  of  chance.  This  line 
of  reasoning  and  the  execution  of  it  must  be  examined  very 
critically,  for  it  constitutes  Spearman's  major  technique  and,  ac- 
cording to  him,  the  only  technique  which  is  adequate.  First  as  to 
the  execution  of  it:  The  formula  (Spearman,  1927,  Formula  16a, 
p.  xi)  which  Spearman  and  Holzinger  (1926)  have  derived  for 
the  standard  deviation  of  the  distribution  of  a  population  of  tetrad 
differences  is 

a  =  2{rHl-ry+(l-R)s*    |* [2] 

wherein  r  is  the  mean  of  all  the  r's  and  s2  is  their  variance,  and 

2?==3r!^_2rg«=6 

n — 2  n — 2 

In  these  equations  n  is  the  number  of  variables  and  N  is  the  size 
of  the  population. 

The  writer  has  criticized  the  earlier  formula  (Spearman  and 
Holzinger,  1926,  Formula  1),  now  replaced  by  this  one,  and  of 
the  use  of  this  later  formula  Spearman  writes :  ".  .  .  .  although  on 
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some  theoretical  points  still  awaiting  further  elucidation  in  practice 
at  any  rate  [it]  appears  to  be  far  more  convenient,  and  even  more 
reliable  than  [Spearman  and  Holzinger's  formulas  giving  the 
probable  errors  of  single  tetrads]."3  The  proof  of  this  very  critical 
Formula  2  has  not  as  yet  appeared  in  print. 

Formula  2  may  be  called  not  merely  a  critical  formula,  but  the 
critical  formula.  Professor  Spearman  states  (1927,  p.  74)  :  ".  .  .  . 
whenever  the  tetrad  equation  holds  throughout  any  table  of  cor- 
relations, and  only  when  it  does  so,  then  every  individual  measure- 
ment of  every  ability  can  be  divided  into  two  independent  parts 
.  .  .  .  [a  general  and  a  specific  factor]."  Formula  2  is  the  final 
criterion  that  Spearman  uses  to  determine  if  the  tetrads  through- 
out the  entire  table  are  merely  chance  deviations  from  zero.  He 
writes  (1927,  p.  137)  :  "To  begin  with,  a  note  of  warning  must 
be  sounded  against  all  attempts  to  replace  the  rigorously  demon- 
strated criterion  by  anything  else.  Many  writers  have  tried  to 
invent  a  new  one  for  themselves ;  others  have  declared  that  so 
many  are  in  the  field  as  to  produce  a  difficulty  in  choosing  between 
them.  Against  this,  we  must  formally  declare  that  no  other 
rigorous  criterion  than  that  demonstrated  here  (including  mere 
equivalent  conversions  of  it)  has  ever  been  proved  or  ever  can  be." 
Professor  Spearman  is  presumably  referring  to  the  tetrad  dif- 
ference formula,  r12  r34 — r13  r24  =  0,  but  we  must  note  that  the 
crux  of  the  matter  is  not  in  the  proposition  that  all  tetrad  differ- 
ences equal  zero,  but  in  the  standard  errors  of  their  actual  values, 
which  deviate  by  chance  or  otherwise  from  zero.  According  to 
Spearman's  method  this  leads  back  to  Formula  2.  Clearly  it  is  the 
basic  formula  in  the  entire  treatment.  If  we  grant  that  Formula  2 
is  correct,  we  may  still  question  the  use  made  of  it,  for  Spearman 
assumes  that  chance  would  yield  a  normal  distribution  of  tetrad 
differences  with  this  standard  deviation.  This  assumption  of  a 
normal  distribution,  even  in  situations  where  one  general  factor 
only  is  present  does  not  seem  reasonable,  for  the  chance  errors  in 
the  correlation  coefficients  are  known  to  be  correlated,  so  that  we 


8  Spearman,  1927,  Appendix,  p.  xi. 
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may  expect  the  chance  errors  in  the  tetrads  also  to  be  correlated, 
and  to  an  appreciable  extent,  for  they  are  only  functions  of  four 
correlation  coefficients  and  the  products  of  correlation  coefficients 
in  pairs  are  repeated  many  times  in  the  total  population  of  tetrad 
differences.  This  would  yield  a  non-normal  distribution,  of  just 
what  form  the  writer  does  not  know.  The  obvious  way  of  using 
the  chance  standard  deviation  of  a  population  of  tetrad  differences 
would  be  to  compare  it  with  the  obtained  standard  deviation,  find 
the  difference  between  the  two,  and  the  standard  error  of  this 
difference.  This  standard  error,  which  will  certainly  be  very 
small,  is  not  known,  and  it  probably  cannot  be  determined  by  any 
means  sufficiently  simple  to  be  serviceable.  Should  one  object  to 
this  proposed  method  of  interpretation  on  grounds  similar  to  those 
just  raised,  namely,  that  the  distribution  of  differences  between 
these  two  standard  deviations  will  not  be  normal  and  thus  not 
readily  interpretable,  it  can  be  shown  that  the  point,  though  not 
without  foundation,  is  much  less  material  here  than  in  the  former 
case. 

How  material  this  particular  criticism  of  Spearman's  use  of 
Formula  2  is,  is  not  known.  It  may  be  quite  trivial.  A  more  im- 
portant criticism  from  the  writer's  point  of  view  is  the  fact  that 
the  situations  in  which  one  is  really  interested  are  not  those  to 
which  it  can  usefully  be  applied.  According  to  Spearman's  latest 
conclusions  there  are  no  less  than  three  general  cognitive  factors — 
g,  oscillation,  and  perseveration — and  a  much  larger  number  of 
group  factors,  including  memory,  a  spatial  factor,  a  conjunction 
factor  (probably  identical  with  what  the  present  writer  calls  a 
number  factor),  a  music  factor,  etc.,  as  well  as  "conative"  factors. 
All  that  Spearman's  criterion  could  tell  us  would  be  that  one  factor 
was  or  was  not  sufficient  to  explain  a  given  situation.  All  of  the 
writer's  data  do  show,  and  he  ventures  to  prophesy  that  all  of 
the  forthcoming  as  well  as  much  of  the  earlier  data  from  Spear- 
man's laboratory  will  show,  the  need  for  more  than  a  single  factor ; 
thus  Spearman's  tool  proves  inadequate.  We  are  no  longer  con- 
cerned with  the  first  step,  "Does  one  factor  suffice?"  but  with  the 
later  steps,  "How  many  and  what  factors  suffice?"    The  writer 
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presents  herein  (chapter  iii)  the  complete  solution  of  the  adequacy 
of  two  factors  in  the  case  of  variables  up  to  the  number  five,  but 
he  has  found  even  this  to  be  inadequate,  for  there  are  found  in  his 
data  more  than  two  general  or  group  factors.  Finally,  the  writer 
presents  an  iteration  method  for  handling  the  problem  when  more 
factors  and  more  variables  are  present  (chapter  iii).  This  method 
seems  to  be  a  powerful  analytical  device.  It  calls,  however,  for  a 
wider  use  and  more  detailed  mathematical  scrutiny  than  it  has  as 
yet  received.  As  to  the  needed  mathematical  scrutiny,  it  can,  in 
brief,  be  said  that  the  writer  has  been  using  an  iteration  method 
and  obtaining  a  convergency  in  a  series  without  having  first  proved 
that  convergency  is  a  mathematical  necessity. 

The  fundamental  technique  of  Spearman  has  been  supple- 
mented by  him  by  a  partial  correlation  procedure.  When  he  has 
found  that  one  independent  factor  was  insufficient,  he  has  par- 
tialed  out  g  and  by  a  study  of  the  residual  correlations  has  found 
additional  factors.  This  procedure  depends  upon  the  ability  to 
obtain  a  measure  of  g  uncontaminated  by  other  factors.  The  diffi- 
culty of  doing  this  is  great,  because  of  the  special  hazards  involved 
in  partialing  out  just  what  is  needed  and  no  more  when  dealing 
with  measures  having  large  chance  elements  in  them,  and  perhaps 
also  having  disconcerting  specific  and  group  factors  in  them.  The 
writer  has  not  attempted  to  follow  carefully  all  of  this  partial 
correlation  treatment,  because  Spearman's  populations  have  been 
very  small,  the  partial  correlations  very  small,  and  the  resulting 
probable  errors  very  large  and,  most  unfortunately,  unknown.  He 
would,  however,  express  the  belief  that  in  spite  of  these  special 
hazards  the  method  has  much  to  commend  it. 

Though  certain  shortcomings  in  the  tools  used  by  Spearman 
have  been  pointed  out,  nevertheless  the  writer  believes  that  on  the 
whole  he  has  used  them  with  rare  judgment  and  has  determined 
the  existence  of  many  important  mental  factors.  In  short,  as 
Spearman's  technique  and  point  of  view  with  reference  to  the 
significance  of  differences  (see  chapter  ix  below,  p.  215)  seems  too 
rigorous,  or,  in  other  words,  unfavorable  to  the  discovery  of  factors 
in  addition  to  g,  we  may  place  rather  special  confidence  in  the 
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reality  of  such  special  factors  as  he  does  report.  The  very  thorough 
review  of  these  to  be  found  in  his  Abilities  of  Man  (1927)  makes 
it  unnecessary  to  give  more  than  a  brief  discussion  of  them  here. 
Professor  Spearman  clearly  distinguishes  cognitive,  conative,  and 
affective  traits,  as  well  as  various  other  traits,  for  example,  re- 
tentivity  and  fatigue.  It  does  not  seem  to  the  writer  that  he  has 
established  by  his  own  method  of  tetrad  differences  the  inde- 
pendence of  these  things.  We  will  therefore,  even  at  the  risk  of 
not  doing  full  justice  to  his  view,  make  no  attempt  to  preserve  his 
classification  of  traits  and  capacities.  We  will  list  those  that  he  has 
found  disparate,  but  we  should  bear  in  mind  that  in  the  main,  by 
his  technique,  differences  of  each  from  g  are  established  rather 
than  complete  difference  of  each  from  each  other. 

First  in  this  list  is  Spearman's  g.  As  measures  of  it,  which 
involve  nothing  else  except  specific  factors,  are  the  "usual  sets  of 
mental  tests"  (1927,  Abilities,  p.  161).  The  number  of  specific 
tests  which  could  here  be  mentioned  is  very  great,  including  in 
addition  to  many  others,  opposites,  synonyms,  classification,  com- 
pletion, questions,  analogies,  paragraphs,  meanings,  memory,  ab- 
stract thought,  accuracy,  inferences  and  likelihood  (1927,  pp. 
224-27).  Owing  to  the  universality  of  g,  Spearman  states  that 
"any  test  will  do  just  as  well  as  any  other,  provided  only  that  its 
correlation  with  g  is  equally  high"  (1927,  p.  197).  The  saturation 
of  measures  with  g  is  not  markedly  affected  by  any  differences  in 
the  fields  of  cognition  (1927,  pp.  203-4).  Again,  "g  proved  to 
be  a  factor  which  enters  into  the  measurements  of  ability  of  all 
kinds,  and  which  is  throughout  constant  for  any  individual,  al- 
though varying  greatly  for  different  individuals.  It  showed  itself 
to  be  involved  invariably  and  exclusively  in  all  operations  of 
eductive  nature,  whatever  might  be  the  class  of  relation  or  the 
sort  of  fundaments  at  issue.  It  was  found  to  be  equally  concerned 
with  each  of  two  general  dimensions  of  ability,  Clearness  and 
Speed.  It  also  applied  in  similar  manner  to  both  the  dimensions 
of  span,  which  are  Intensity  and  Extensity.  But  it  revealed  a  sur- 
prisingly complete  independence  of  all  manifestations  of  Reten- 
tivity.    Whether  there  is  any  advantage  in  attaching  to  this  g  the 
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old  mishandled  label  of  'intelligence'  seems  at  least  dubious" 
(1927,  p.  411).  In  brief,  Spearman's  concept  is  that  g  is  the  ability 
to  deduce  relations  and  correlates,  and  is  dependent  upon  a  central 
fund  of  energy. 

The  experimental  results  reported  in  later  chapters  hardly  sup- 
port this  concept,  because  there  seem  to  be  two,  and  perhaps  three, 
traits  combined  in  this  one  concept.  First,  there  is  a  factor  making 
for  correlation  between  variables  due  to  maturity,  race,  sex  dif- 
ferences, and  differences  of  antecedent  nurture.  That  these  things 
would  strongly  tend  to  introduce  a  general  factor  is  shown  in 
chapter  ii  of  this  book,  and  that  Spearman  pays  far  too  little  atten- 
tion to  them  is  very  obvious  to  one  going  over  the  various  experi- 
mental investigations  that  have  been  made  in  his  laboratory  and 
under  his  direction.  In  fact,  he  writes,  "Also  worthy  of  mention, 
though  hardly  of  prolonged  examination,  is  the  taking  of  g  to  have 
reference  only  to  children,  being  in  fact  no  more  than  a  measure- 
ment of  their  maturity.  One  child  does  better  at  the  tests  than 
another  of  the  same  age,  it  is  said,  only  because  of  being  more 
precocious"  (1927,  p.  90).  Though  this  statement  implies  the  com- 
parison of  children  of  the  same  age,  Spearman's  groups  typically 
have  not  been  children  of  the  same  age,  and  he  has  not  resorted  to 
a  partial  correlation  technique  to  reduce  his  data  to  a  constant  age 
basis.  Certainly  race  and  nurture  have  not  been  partialed  out,  and 
only  very  occasionally  has  sex  been  experimentally  treated  as  a 
separate  factor.  It  is  regrettable  that  this  very  fundamental  matter4 


4  It  may  be  that  neglect  of  nurture  as  a  factor  has  been  caused  by  a 
belief  that  its  influence  is  specific.  We  find  one  of  Spearman's  students 
(Slocombe,  1926)  stating:  "How  is  it  then,  that  practice,  though  present  and 
producing  an  increase  in  score,  does  not  influence  g  as  measured?  It  is 
inferred  that  the  influence  of  practice  is  specific  to  the  form  of  test.  Thus 
when  a  number  of  test  forms  are  combined,  practice  enters  as  an  uncorre- 
cted specific  factor." 

The  data  of  Slocombe,  based  upon  a  growth  or  nurture  period  of  three 
months  only,  are  most  inadequate  for  so  important  a  conclusion.  The  contra- 
dictory view  is  indicated  upon  many  counts  in  the  present  writer's  study, 
"The  Influence  of  Nurture  upon  Native  Differences"  (1926),  which  includes 
data  extending  over  a  considerable  range  of  years. 
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of  maturity  has  not  been  thought  worthy  of  prolonged  examina- 
tion. On  a  priori  grounds  why  should  one  consider  it  of  less 
significance  in  connection  with  intellect  than  with  bodily  structure  ? 

The  second  factor  which  the  writer  finds  clearly  indicated  in 
his  own  data,  and  which  is  undoubtedly  present  in  the  tests  measur- 
ing g,  is  a  verbal  factor,  for  the  tests  that  Spearman  regularly  uses 
as  the  better  measures  of  g  are  very  similar  to  those  in  which  the 
writer  has  found  a  large  verbal  factor.  One  might  say  that  this  is 
merely  quibbling  over  terms,  and  that  what  the  present  writer 
means  by  a  verbal  factor  is  what  Spearman  means  by  g.  This  does 
describe  the  situation  in  part,  though  the  writer  finds  that  the 
verbal  factor  is  more  limited  in  its  scope  than  the  statements  of 
Spearman  would  indicate  his  g  to  be.  It  is  nevertheless  probably 
true  that  fully  one-half  of  Spearman's  g  is  represented  by  what  is 
here  called  a  verbal  factor. 

A  very  recent  study  by  one  of  Spearman's  students  (Davey, 
1926)  gives  data  from  which  the  author  concludes  that  there  is  no 
general  verbal  factor.  Dr.  Davey  reports  the  distribution  of  tetrads 
of  the  form  ttS24,  in  which  xx  equals  the  score  on  an  oral  test, 
x3,  that  on  a  second  oral  test,  x2,  that  on  a  pictorial  test,  and  x4, 
that  on  a  second  pictorial  test.  The  median  of  such  tetrads  is  .021, 
and  the  probable  error  (of  the  distribution,  not  of  the  median)  by 
Spearman's  Formula  2  is  .019.  This  clearly  shows  a  verbal  factor, 
but  Davey,  picking  out  four  of  the  eight  verbal  tests  which  have 
contributed  the  greatest  to  the  creation  of  this  median  difference, 
finds  that  the  median  of  the  distribution  of  the  remaining  tetrads 
is  approximately  zero.  This  process  of  selection  is  unwarranted, 
for  the  very  act  of  a  posteriori  selecting  the  four  tests  has  capi- 
talized chance  in  one  direction,  that  of  not  yielding  a  verbal  factor. 
We  are  surely  warranted  in  disagreeing  with  Davey  and  in  fact  in 
citing  his  data  as  indicating  a  verbal  factor  of  fairly  wide  extent. 

Finally,  there  may  be  a  third  factor — not  variability,  in  ma- 
turity, in  sex,  in  race,  in  nurture ;  and  not  verbal — present  in 
Spearman's  g.  The  writer  believes  that  if  such  a  residual  factor 
remains,  after  an  allowance  for  the  things  mentioned,  it  is  very 
small.  A  general  factor,  not  verbal,  is  found  by  the  writer  through- 


BOUNDARIES  OF  MENTAL  LIFE  19 

out  his  work,  but  as  he  has  not  allowed  for  sex,  race,  or  nurture, 
and  probably  not  adequately  for  maturity,  it  is  truly  an  open  ques- 
tion whether  any  g  factor  at  all  would  exist  if  these  things  had 
been  properly  taken  into  account. 

The  data  which  most  adequately  take  into  account  maturity 
and  sex  is  the  Army  Alpha  data  quoted  very  disparagingly  by 
Spearman.  As  to  the  facts  we  can  all  agree  that  a  single  general 
factor  is  not  indicated.  As  to  the  cause,  Spearman  writes  that  by 
the  procedure  followed,  "the  subjects,  and  still  more  so  the  testing, 
must  have  become  heterogeneous  to  the  last  degree."  Knowing 
something  of  the  care  with  which  this  testing  work  was  done,  the 
writer  does  not  believe  the  second  of  these  charges  is  justified.  As 
to  the  first  charge,  it  is  true  that  the  group  was  rather  hetero- 
geneous, but  this  fact  would  introduce  a  g  factor,  not  take  out  one 
already  there.  In  brief,  these  data,  almost  unique  in  that  they 
allow  for  maturity  and  sex,  for  the  group  consisted  of  adult  men, 
do  not  yield  a  comprehensive  g  factor.  A  further  study  of  the 
Army  Alpha  data  is  made  in  chapter  ix  below. 

The  relationship  pictured  by  Spearman  between  education  and 
g  is  stated  in  the  following  words :  "On  the  whole,  the  most  rea- 
sonable conclusion  for  the  present  appears  to  be  that  education  has 
a  dominant  influence  upon  individual  differences  in  respect  of 
j  (specific  factors),  but  normally  it  has  little  if  any  in  respect  of  g" 
(1927,  Abilities,  p.  392).  The  writer  has  shown  in  an  earlier  study 
(1927,  Interpretation)  that  there  is  a  great  community  of  function 
between  general  intelligence  and  general  scholastic  achievement.  If 
Spearman  is  correct  in  his  statement,  then  general  scholastic 
achievement  is  of  necessity  little  affected  by  education.  Though 
this  may  be  so  to  an  extent  not  ordinarily  suspected,  at  least  in 
certain  respects  it  has  been  found  by  the  writer  not  to  be  the  case 
(Kelley,  1926,  Influence).  Further  data  and  comment  upon  this 
important  point  are  given  below  in  chapter  vi. 

From  Spearman's  great  dependence  upon  a  central  fund  of  in- 
tellective energy  as  a  highly  important  category  of  mental  life  to  a 
view  wherein  no  general  factor  exists  is  indeed  a  far  step,  but  one 
quite  within  the  realm  of  possibility,  judging  by  all  the  data  at  hand. 
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The  nurture  element  earlier  mentioned  as  a  source  of  a  general 
factor  would  be  a  general  nurture,  i.e.,  a  tendency  of  the  environ- 
ment to  stimulate  or  repress  all  intellectual  development.  Over 
and  above  this  there  may  be  a  nurture  operating  on  particular 
phases  only  of  intellectual  life,  for  example,  an  environment  tend- 
ing to  stimulate  or  repress  number  ability.  In  either  case  there  is 
no  way,  except  by  studying  different  age  groups,  to  differentiate 
between  native  and  acquired  traits.  Accordingly,  with  reference  to 
the  group  traits  found,  we  must,  while  noting  Spearman's  findings, 
be  content  to  be  concerned  with  the  question  of  their  existence 
rather  than  of  the  original  or  acquired  nature  of  their  origins. 

A  trait  designated  "perseveration"  is  considered  by  Spearman 
to  be  a  universal  factor.  It  is  an  expression  of  his  fundamental 
"law  of  inertia."  The  sensory  tests  (speed  of  rotation  of  a  color 
disk  to  cause  fusion;  seconds  needed  for  adaptation  to  darkness) 
employed  by  Wiersma  (1906)  showed  rather  systematic  differ- 
ences in  the  case  of  11  maniacs,  9  normals,  and  18  melancholies. 
Heymans  and  Brugmans  (1913)  with  these  same  tests  and 
with  others  obtained,  in  the  case  of  15  normal  subjects,  such 
low  correlations  that  no  very  likely  conclusion  is  indicated  from 
their  data.  Next,  Wynn  Jones  (see  Spearman,  1927)  tested 
"77  children  about  12  years  of  age"  with  tests,  all  of  which  in- 
volve motor  activity  and  habits.  The  attempt  was  made  to  elimi- 
nate the  motor  factor  by  employing  other  motor  tests  not  involving 
"perseveration,"  but  this  should  surely  be  called  unsuccessful,  be- 
cause the  inter-correlations  were  very  low,  averaging  .09,  which 
we  may  expect  to  have  been  due  largely  to  the  unreliability  of  the 
tests.  Spearman  writes,  "nothing  of  this  diminutive  size  could 
possibly  account  for — or  even  by  being  eliminated  sensibly  diminish 
— the  correlations  shown  in  the  foregoing  table."  This  is  true  but 
altogether  insufficient,  as  the  author  of  the  correction  for  attenua- 
tion should  know,  for  one  cannot  partial  out  a  motor  factor  by 
partialing  out  the  scores  on  motor  tests  of  very  low  reliability. 
Finally,  there  is  the  study  of  Lankes  (1914)  involving  47  students 
in  the  Islington  Day  Training  College  (ages  and  sex  not  indi- 
cated).  His  array  of  tests  is  quite  extensive,  but  his  inter-correla- 


BOUNDARIES  OF  MENTAL  LIFE  21 

tions  are  so  low,  running  from  — .05  to  .51,  and  averaging  .22,  and 
his  population  so  small,  that  probable  errors  are  very  large.  The 
data  are  hardly  serviceable  in  proving  the  existence  of  a  persevera- 
tion factor.  From  the  Wiersma,  Heymans  and  Brugmans,  Jones, 
and  Lankes  data,  Spearman  not  only  deduces  a  "perseveration" 
factor,  but  he  defines  many  of  its  characteristics.  These  data  are 
surely  a  feeble  foundation  for  so  imposing  a  superstructure.  The 
writer  believes  that  factors  other  than  g  are  indicated  by  these 
data,  but  that  it  is  hazardous  to  say  more  than  this. 

A  trait  called  "oscillation"  is  presented  as  a  third  universal 
cognitive  factor.  Its  experimental  foundation  is  perhaps  a  trifle 
more  adequate  than  in  the  case  of  "perseveration,"  for  the  largest 
population  studied  consisted  of  "about  80  children  aged  about  12 
years."  Here  the  inter-correlations  ranged  from  .00  to  .44,  with 
an  average  of  .21.  Somewhat  more  adequate  intelligence  measures 
were  available  for  this  group. 

One  further  general  factor,  this  time  connected  with  the  field 
of  conation,  is  considered  to  be  present.  This  is  Webb's  (1915) 
"persistence  of  motives,"  and  Garnett's  (1919)  "purpose"  factor. 
The  difficulty  of  establishing  this  is  greatly  increased  by  the  fact 
that  it  is  deduced  from  personal  judgments  and  not  from  objec- 
tive test  scores.  However,  the  population  was  large,  "200  students 
with  an  average  age  of  21  years,"  and  the  evidence  quite  clear-cut 
that  there  is  more  than  one  factor  present — the  factors  being  q 
and  "persistence  of  motives"  according  to  Webb,  and  q,  "pur- 
pose," and  "cleverness"  according  to  Garnett.  A  thing  much  to  be 
hoped  for  is  the  measurement  of  these  factors  in  a  more  objective 
manner,  and  a  more  exact  establishment  of  their  place  in  mental 
life. 

Let  us  now  note  briefly  other  factors  which  Spearman  calls 
group  factors,  because  he  considers  them  of  less  universality  than 
the  general  factors.  There  has  been  no  criterion  established  justi- 
fying, say  "perseveration"  as  a  general  factor,  and  "memory"  as 
a  group  factor.  In  either  instance,  and  also  in  the  case  of  q,  the 
evidence  of  the  generality  of  the  factor  depends  upon  the  measures 
employed  in  the  investigation.   With  reference  to  a  designated  set 
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of  measurements  through  all  of  which  runs  a  certain  factor  A, 
through  several  of  which  runs  a  factor  B,  and  in  one  of  which  is  a 
factor  C,  the  writer  sees  a  value  in  the  terms  general,  group,  and 
specific;  but  this  value  is  only  in  the  descriptive  power  of  these 
terms  for  the  particular  situation  which  is  being  investigated. 
Given  other  tests,  the  A  factor  might  become  specific,  the  B  factor 
become  general,  and  the  C  factor  become  a  group  factor.  To  de- 
termine factors  which  are  not  thus  dependent  upon  a  particular 
set  of  tests,  it  is  necessary  to  utilize  many  measures  at  once,  thus 
making  a  very  exhaustive  survey  of  the  mental  ability  of  the 
subjects  tested.  In  noting  factors  reported  by  Spearman  additional 
to  those  already  mentioned  we  will  not  draw  a  distinction  between 
general  and  group  factors. 

There  is  a  memory  factor  certainly  extending  to  different  sen- 
sory fields  and  to  verbal  material. 

One  of  Spearman's  "ideal"  relations  is  "conjunction,"  and  he 
finds  a  factor  of  this  nature.  The  writer  prefers  to  call  it  a  "num- 
bers" or  "arithmetical"  factor  as  being  more  descriptive  of  the 
content  and  nature  of  the  tests  revealing  it. 

There  is  a  constructive  mechanical  ability  factor  which  may  be 
related  to  that  characterized  by  the  writer  as  "manipulation  of 
spatial  relationships." 

Dealing  with  this  trait,  McFarlane  (1925)  reports  that  the 
factor  is  found  in  the  case  of  boys  and  not  in  that  of  girls.  Certain 
other  evidence  of  sex  differences  is  cited,  but  no  extensive  treat- 
ment of  sex  as  a  factor  in  mental  life  is  undertaken  by  Spearman. 
There  is  a  great  deal  of  literature  bearing  upon  this  matter.  Note- 
worthy in  this  is  the  study  already  made  by  Terman  (1925),  as 
well  as  a  further  investigation  by  him  now  under  way.  They  sug- 
gest rather  far-reaching  mental  differences  which  are  correlated 
with  sex. 

The  reader  must  not  conclude  because  of  the  criticisms  that 
have  been  made  of  Spearman's  technique  and  interpretation  that 
there  is  wide  disagreement  between  his  findings  and  those  of  the 
present  writer.  On  the  whole  the  two  sets  of  findings  are  quite 
remarkably  in  harmony,  the  agreements  being  in  the  matter  of  a 
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spatial,  a  numerical,  a  memory,  and  even  a  general  factor,  though 
this  last  is  differently  interpreted,  and  also  in  the  conclusion  that  a 
large  number  of  specific  motor  (probably  also  sensory)  factors 
exist.  There  is  scarcely  a  disagreement  in  the  matters  of  music, 
purpose,  cleverness,  and  sex,  though  here  the  data  are  inadequate. 
There  does  seem  to  be  a  real  disagreement  in  the  importance  and 
extent  of  a  verbal  factor  and  in  that  of  a  mental  speed  factor. 

In  addition  to  the  contributions  to  this  problem  of  mental  life 
made  by  Spearman  and  his  students,  and  by  such  continental 
workers  as  are  referred  to  by  him,  attention  should  be  called  to  the 
work  of  a  considerable  number  of  other  students,  particularly  in 
America  (for  citation  of  these,  see  Kelley,  1927,  Interpretation, 
chap,  iv,  dealing  with  "The  Determination  of  Idiosyncracies"), 
and  also  a  rich  literature,  though  statistically  rather  difficult  to 
handle,  bearing  upon  racial  differences.  Certain  of  these  studies 
not  earlier  reviewed  by  the  writer  ( 1927,  Interpretation)  are  scruti- 
nized in  some  detail  in  chapter  ix  below.  Preceding  the  discussion 
of  these,  the  main  body  of  new  data  collected  by  the  writer  is 
given  in  chapters  iii  to  viii  following. 

It  is  admitted  that  the  treatment  of  the  present  chapter  and 
related  treatments  by  the  writer  (Kelley,  1927,  Interpretation, 
chap,  iv)  are  an  inadequate  discussion  of  psychological  points  of 
view,  varied  both  as  to  phenomena  dealt  with  and  methods  em- 
ployed. They  may,  however,  suffice  to  emphasize  the  variety  of 
mental  activity  of  which  man  is  master  and  to  outline  a  picture  of 
mental  life  which  future  study  will  fill  in.  In  brief,  the  bound- 
aries of  mental  traits  are  ruts,  not  far-flung  indefinite  fringes  of 
consciousness.  Mental  life  does  not  operate  in  a  plain  but  in  a 
network  of  canals.  Though  each  canal  may  have  indefinite  limits 
in  length  and  depth,  it  does  not  in  width ;  though  each  mental  trait 
may  grow  and  become  more  and  more  subtle,  it  does  not  lose  its 
character  and  discreteness  from  other  traits. 


CHAPTER  II 

TRAITS  AS  GROUP  PHENOMENA 

One  of  the  most  common  findings  of  mental  measurement  has 
been  the  fact  that,  generally  speaking,  correlation  exists  between 
the  scores  of  different  mental  tests.  Further,  if  "good,"  "high," 
or  "excellent"  scores  receive  higher  numerical  values  than  "poor," 
"low,"  and  "unsatisfactory"  scores,  then  it  has  generally  been 
found  that  the  correlation  between  scores  is  positive.  This  is  so 
common  a  finding  that  the  writer  will  not  stop  to  cite  evidence.  It 
has  been  found  for  groups  which  were  as  heterogenous  as  one 
composed  of  tramps  and  university  graduate  students,  as  well  as 
for  groups  as  homogeneous  as  those  of  a  single  age,  or  those  found 
in  a  single  school  grade,  though  in  this  latter  case  the  correlations 
found  between  different  mental  tests  have  been  fairly  low.  A  num- 
ber of  causes  may  contribute  to  these  universal  findings,  such 
causes,  for  example,  as  the  use  of  groups  of  heterogeneous  (a) 
maturity,  (b)  racial  origin,  (c)  nurture,  (d)  sex,  also  (e)  the 
poor  selection  of  mental  tests  employed,  or  (/)  an  intrinsic  simi- 
larity in  all  mental  activities.  In  so  far  as  (a),  (b),  (c),  (d),  and 
(e)  are  the  causes,  (/)  is  not.  In  the  sense  in  which  here  used,  a 
number  of  tests  which  were  very  similar  to  each  other  would  be 
called  a  "poor"  selection.  The  pertinence  of  the  first  four  causes 
may  be  pointed  out  by  assuming  that  there  exist  at  least  two  inde- 
pendent mental  traits  and  then  noting  that  heterogeneity  in  popula- 
tions studied,  introduced  through  (a),  (b),  (c),  or  (d),  will  pre- 
sumably lead  to  positive  measures  of  correlation  between  the  two 
intrinsically  independent  traits.  The  accompanying  numerical  ex- 
ample in  Table  I  illustrates  case  (a). 

If  each  child  is  measured  at  that  age  at  which  his  maturity  is 
one-half  of  his  adult  maturity,  he  will  receive  the  scores  in  the  two 
traits  as  given  in  columns  2  and  3,  and  as  may  be  easily  shown  by 
calculation  the  correlation  between  these  two  traits  is  zero.  Now 
let  us  suppose  that  maturity  in  the  first  trait  goes  with  maturity  in 
the  second;  for  example,  if  at  a  certain  time  a  child  possesses 
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^--proportion  of  his  adult  arithmetic  reasoning  ability  he  likewise 
possesses  y-proportion  of  his  adult  reading  ability,  and  when  a 
second  child  possesses  .r-proportion  of  his  adult  arithmetic  reason- 
ing ability  he  likewise  possesses  y-proportion  of  his  adult  reading 
ability,  etc.  To  make  the  numerical  illustration  simple  we  will  here 


TABLE  I 

Hypothetical  Scores  of  Ten  Children  on  Two  Intrinsically 
Independent  Traits 


(1) 

Individuals 

(2) 

Trait  1:  Score 

at  a  Maturity 

Level  Equal  to 

Vs.  That  of  Adult 

(3) 

Trait  2:  Score 

at  a  Maturity 

Level  Equal  to 

%  That  of  Adult 

(4) 

Maturity 

Influence 

at  Time  of 

Measurement 

(5) 

Resulting 

Trait  1 

Score 

(6) 

Resulting 
Trait  2 
Score 

A 

8 

9 

—1 

7 

8 

B 

9 

10 

0 

9 

10 

C 

9 

11 

1 

10 

12 

D 

10 

8 

2 

12 

10 

E 

10 

12 

—2 

8 

10 
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10 

10 

—1 

9 

9 

G 

10 

10 

0 

10 

10 

H 

11 

10 

1 

12 

11 

1 

11 
12 

11 
9 

0 

11 
12 

11 

J 

9 

assume  perfect  correlation  between  the  proportions  x  and  y  as  age 
changes,  but  to  establish  the  point  at  issue  it  is  only  necessary  to 
suppose  that  there  is  positive  correlation  between  them.  Column  4 
contains  the  entry  ( —  1)  for  the  maturity  measure  pertaining  to 
individual  A.  This  states  that  when  measured  he  was  less  mature 
than  the  average  of  the  group  of  10.  Adding  this  (  —  1)  to  his 
Trait  1  and  again  to  his  Trait  2  scores,  we  obtain  the  values  7  and 
8  as  given  in  columns  5  and  6.  Thus  if  individual  A  is  young  as 
judged  by  the  average  maturity  of  the  group  when  he  is  tested,  he 
makes  a  score  of  7  on  the  first  test  and  of  8  on  the  second,  not  the 
scores  of  8  and  9  which  he  would  make  if  tested  a  little  later  in 
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life.  In  a  similar  manner  we  get  scores  9  and  10  in  columns  5  and 
6  as  the  obtained  scores  for  individual  B  ;  10  and  12  as  the  obtained 
scores  for  individual  C ;  etc.  Calculation  of  our  hypothetical  data 
shows  that  columns  5  and  6  are  quite  substantially  correlated.  We 
accordingly  see  from  it  that  individuals  possessed  of  two  traits 
between  which  there  is  zero  correlation,  if  tested  at  the  same  stages 
of  maturity,  show  traits  which  are  correlated  when  the  individuals 
of  the  group  are  tested  at  different  levels  of  maturity,  provided 
only  that  there  is  correlation  between  the  maturity  of  the  two 
traits.  Now  the  writer  is  unaware  of  any  mental  traits  in  which 
growth  during  the  days  of  childhood  does  not  take  place,  and  thus 
for  all  traits  in  which  the  status  of  the  child  is  low  in  very  early 
life  and  high  at  adulthood  there  is  a  necessary  correlation  between 
the  maturity  of  the  traits. 

The  reader  can  readily  satisfy  himself  that  race  heterogeneity, 
providing  the  individuals  of  the  one  race  are  on  the  average  lower 
as  adults  in  both  the  two  traits  considered  than  those  of  the  other 
race,  operates  to  introduce  correlation  just  as  do  unequal  levels  of 
maturity.  Similar  observations  apply  to  sex  and  nurture.  We  may 
therefore  conclude  that  even  if  the  selection  of  the  two  mental 
traits  is  excellent  in  the  sense  that  the  mental  capacities  are  intrin- 
sically independent,  positive  correlation  will  nevertheless  com- 
monly be  found  between  them,  owing  to  the  heterogeneity  of 
population  employed. 

Though  it  is  obvious  that  the  correlation  due  to  differences  in 
maturity,  in  racial  stock,  in  sex,  and  in  nurture  should  be  ruled  out, 
it  is  by  no  means  clear  just  how  far  one  should  go  in  securing 
homogeneous  experimental  groups.  It  is  to  be  expected  that 
10-year-old  boys  are  not  all  of  the  same  degree  of  maturity,  that  is, 
they  have  not  accomplished  the  same  fraction  of  their  adult  stand- 
ing. This,  however,  seems  to  be  a  relatively  unimportant  point,  for 
children  so  far  asunder  as  imbeciles  and  children  of  IQ  150  have 
growth  curves  in  which  the  fractions  of  adult  mental  stature  at- 
tained at  successive  stages  are  approximately  the  same.  Accord- 
ingly, one  may  substantially  eliminate  the  maturity  influence  by 
choosing  age-homogeneous  groups. 
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The  securing  of  groups  which  are  homogeneous  from  the 
racial  standpoint  offers  greater  difficulty.  In  the  study  herewith 
reported  American  white  school  children  in  a  single  school  grade 
have  been  thrown  together  to  provide  a  single  group.  In  a  more 
extended  further  study  this  should  not  be  the  case,  for  the  sexes 
should  be  treated  separately,  those  of  different  ages  in  the  same 
grade  separately,  and  those  of  the  same  age  in  different  classes 
brought  together,  and  still  other  steps  taken  to  secure  homogeneity. 
The  sexes  were  thrown  into  a  single  group  in  the  present  study  to 
secure  larger  populations,  but  the  writer  is  led  to  believe,  particu- 
larly because  of  certain  as  yet  unpublished  findings  of  Dr.  L.  M. 
Terman,  that  either  the  sexes  should  have  been  treated  separately, 
or  an  independent  variable,  sex,  should  have  been  introduced  and 
later  partialed  out. 

Would  children  all  of  the  same  race,  same  age,  and  same  sex 
constitute  a  homogeneous  group  ?  Would  children  of  the  same  age, 
same  race,  same  sex,  and  same  general  level  of  parental  intelligence 
constitute  an  appropriate  group?  Would  children  of  the  same  race, 
same  age,  same  sex,  and  same  parents  provide  the  group  desired? 
Presumably  this  latter  would  be  too  homogeneous,  because  any 
dominant  trait  through  either  parent  would  yield  similar  measures 
in  offspring,  whereas  the  trait  might  be  very  independent  as  judged 
by  other  members  of  the  same  race.  To  illustrate,  let  us  suppose 
that  a  certain  type  of  musical  ability  is  dominant.  The  children  of 
parents  one  of  whom  is  duplex  in  this  trait  all  possess  this  ability. 
If  it  shows  equally  in  each  child  and  if  the  family  of  sibs  constitute 
the  experimental  group,  there  would  be  no  evidence  that  any  of 
them  were  superior  in  this  trait.  Of  course  no  one  is  superior  to 
the  rest,  but  all  may  be  greatly  superior  to  the  rest  of  mankind ; 
and  thus  the  very  fact  we  wish  to  know  is  concealed,  owing  to  the 
extreme  homogeneity  of  the  group. 

Let  us  suppose  a  second  situation :  Two  races  living  together, 
the  one  being  superior  in  Trait  a,  let  us  say  music,  and  the  other  in 
Trait  b,  let  us  say  mathematics.  If  there  is  great  difference  be- 
tween the  two  races  in  these  two  traits,  the  fact  that  they  live  in 
the  same  community  does  not  mean  that  they  compete  with  each 
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other  in  the  matter  of  musical  and  mathematical  activities.  In 
general,  the  members  of  the  first  race  will  forswear  mathematics 
and  compete  among  themselves  in  music,  and  the  second  race  will 
permit  the  first  race  to  provide  the  musical  entertainment  while 
they  enjoy  the  mathematical  offerings  of  society.  In  other  words, 
living  in  the  same  community  is  not  sufficient  warrant  for  throw- 
ing two  peoples  together  into  a  single  experimental  group.  Rather, 
if  the  members  of  the  two  races  are  to  be  placed  in  a  single  group 
when  studying  Traits  a  and  b,  it  should  be  because  the  mean  adult 
accomplishments  of  the  two  races  are  substantially  the  same  in 
these  two  traits. 

Throwing  together  races  as  described,  one's  findings  would  of 
course  be  with  reference  to  such  groups ;  and  this  is  as  it  should 
be.  We  cannot  establish  facts  of  heredity,  unitary  traits,  etc.,  as 
true  per  se  quite  independent  of  the  culture  from  which  the  data 
have  come.  If  all  the  inhabitants  of  Mars,  granting  there  are  such, 
have  the  musical  ability  of  Wagner  they  will  not  discover  that  they 
are  exceptional  in  musical  ability ;  and  if  a  guidance  expert  from 
this  earth  were  to  drop  in  upon  them  and  give  the  Seashore  Musi- 
cal Ability  and  the  Terman  General  Intelligence  tests  he  would 
make  a  rather  sorry  job  of  counseling  if  he  advised  everyone  to 
follow  music  as  a  vocation,  for  probably  even  Martians  could  not 
live  by  music  alone.  The  Volga  boatmen  may  all  be  more  musical 
than  the  bandmasters  of  North  America,  but  if  they  must  live 
along  the  Volga  they  should  be  boatmen  and  not  bandmasters. 
These  observations  are  made  to  justify  the  use  of  a  group  mean  as 
a  point  of  reference  in  the  present  study  and  in  any  study  having 
as  its  purpose  the  discovery  of  unitary  mental  traits. 

As  pointed  out,  a  fraternity  is  too  homogeneous  a  group ;  and 
the  entire  population  of  mankind  is  too  heterogeneous  because  this 
latter  includes  groups  which  are  not  in  fact  competing  cultures. 
Travelers  in  the  Near  East  report  that  the  Turks  and  Armenians, 
though  living  in  the  same  territory,  engage  in  different  pursuits 
and  that  each  establishes  his  own  social  setting.  One  making  an 
examination  of  these  two  races  for  a  number  of  mental  traits 
would  undoubtedly  find  differences  in  racial  mean  scores.    Such  a 
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finding  would  first  give  us  evidence  that  the  two  races  should  not 
be  combined  in  a  single  race  study ;  and,  provided  the  one  race  did 
not  hold  a  higher  general  level  in  all  traits  than  the  other,  it  would, 
secondly,  give  us  evidence  as  to  what  were  independent  mental 
traits.  A  study  of  racial  differences  can  be  made  the  means  of 
determining  differentiable  mental  abilities,  as  can  the  study  of 
idiosyncracies  within  a  homogeneous  racial  group. 

It  would  seem  that  the  findings  of  the  two  types  of  study 
would  of  necessity  point  in  the  same  direction,  for  if  two  traits, 
say  music  and  mathematics,  are  independent  in  the  members  of  a 
race  A,  it  is  rather  difficult  to  think  of  them  as  being  other  than 
biologically  independent  in  race  B.  Also,  if  independent  in  race  A, 
it  would  be  possible  to  breed  by  selection  from  race  A  a  new  race 
A',  which  would  have  different  mean  scores  in  these  two  traits 
than  the  mean  scores  of  race  A.  Having  done  this,  race  A'  and 
race  A  will  show  racial  differences  which  are  manifest  in  connec- 
tion with  the  same  traits  as  were  the  unitary  traits  in  race  A.  Such 
a  result  as  this  can,  of  course,  only  happen  with  reference  to  traits 
which  are,  in  part  at  least,  independent  of  each  other.  A  study  of 
racial  differences  would  reveal  traits  which,  in  part  at  least,  are 
independent,  while  the  study  of  idiosyncracies  within  a  homoge- 
neous race  can  reveal  traits  which  are  completely  independent. 
These  two  types  of  study  should  never  be  in  conflict,  though  the 
latter  can  go  farther  in  the  matter  of  mental  analysis  than  the 
former.  Though  they  throw  light  upon  the  same  issue  one  should 
endeavor  to  keep  the  two  types  of  study  distinct.  The  individual 
study  can  be  freed  of  a  racial  bias  if  the  races  combined  into  a 
single  group  are  such  as  have  at  a  given  age  the  same  mean  levels 
of  attainment  in  the  traits  in  question.  Here  in  America  we  can 
throw  together  a  number  of  racial  stocks  and  approximate  this 
condition. 

The  reader  is  not  to  think  of  this  as  an  empirical  sort  of  pro- 
cedure, removing  the  study  from  recognized  biological  practice. 
This  approach  does  not,  in  fact,  constitute  a  difference  from  that 
followed  in  the  very  valuable  heredity  studies  which  have  been 
conducted  in  the  animal  and  plant  kingdoms.   The  thing  that  con- 
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stitutes  a  trait  in  the  study  of  the  vinegar  fly  is  something  which 
has  been  found  to  vary  from  the  "wild  type"  condition.  The  wild 
type  is  a  point  of  departure  in  the  studies  of  drosophila  as  is  the 
existing  cultural  level  in  studies  of  human  character  traits.  This 
argument  forces  us  to  the  conclusion  that  what  constitutes  a  trait 
of  a  human  being  depends  upon  the  other  human  beings  with 
whom  he  comes  into  contact.  A  certain  Jew  would  have  certain 
traits  in  Central  Africa,  others  in  the  Ghetto  in  New  York,  and  still 
others  in  Peking.  This  may  seem  confusing,  since  the  person 
himself  has  not  changed. 

There  are  two  alternatives,  neither  of  which  involves  this 
change  in  trait  with  change  in  location.  One  point  of  view  would 
be  to  use  the  mean  of  all  the  races  in  the  world  as  the  point  of 
departure,  so  that  when  a  person  is  once  defined  in  terms  of  this 
world-wide  standard  no  re-definition  is  necessary  attendant  upon 
a  change  in  geographical  location.  This  procedure  has  the  very 
serious  drawback  that  when  interpreting  the  status  of  an  indi- 
vidual of  a  certain  racial  or  national  culture  two  things  must  be 
known:  (a)  the  relation  of  the  individual  to  the  world-wide  stand- 
ard ;  and  (b)  the  relation  of  the  culture  to  the  world-wide  standard. 
It  thus  seems  that  the  world-wide  standard  is  one  derived  from  too 
wide  a  cultural  group  to  be  meaningful  for  national  and  local 
problems. 

The  other  alternative  is  to  take  one's  self  as  a  standard  and 
compare  each  and  every  other  person  with  one's  self.  Then,  so  far 
as  one's  own  interpretations  of  a  second  person  are  concerned,  no 
change  is  demanded  in  passing  over  national  or  cultural  bound- 
aries. This  method,  though  perhaps  very  common,  is  not  service- 
able as  a  method  which  can  be  made  objective,  passed  from 
individual  to  individual,  and  used  as  a  basis  of  general  social 
understanding. 

Finally  it  may  be  noted  that  the  groups  used  in  this  study — 
American  white  children  in  a  given  school  grade — do  not  consti- 
tute poor  samplings  of  what  would  correspond  to  educational  cul- 
tural groups  in  America,  though  sex,  age,  and  race  factors  are  not 
allowed  for  in  the  best  manner  possible.  Though  these  factors  are 
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not  large  they  should  be  more  adequately  taken  into  account  in  a 
further  study.  From  the  standpoint  of  strict  biological  treatment 
it  is  unfortunate  that  we  do  not  have  a  homogeneous,  stable,  origi- 
nal human  type,  such  as  is  the  wild  type  in  connection  with 
drosophila,  to  serve  as  a  point  of  departure  for  all  trait  investiga- 
tions. In  the  case  of  the  vinegar  fly  the  outstanding  characteristic 
of  the  wild  type  is  its  stability.  It  is  questionable  whether  any- 
thing which  might  be  called  a  wild  type  in  the  human  species  pos- 
sesses this  •characteristic.  One  very  stable  feature  of  the  human 
civilization  of  this  country,  possibly  the  most  stable,  is  that  repre- 
sented by  the  average  of  the  white  population,  so  that  we  can 
scarcely  do  better  than  intentionally  choose  a  white  group  to  work 
with,  one  homogeneous  with  respect  to  age  and  sex  and  random 
with  respect  to  race,  except  that  all  races  known  to  have  different 
mean  attainments  should  be  kept  separate. 

It  is  to  be  noted  that  the  negro  population  is  not  included  in  a 
group  as  described,  since  for  many  traits,  especially  those  repre- 
sented by  our  common  general  intelligence  and  psychological  tests, 
it  is  known  that  substantial  race  differences  exist  between  Ameri- 
can white  and  negro  samplings.  The  stability  of  the  average  based 
upon  a  sampling  of  both  populations  would  be  less  than  that  based 
upon  but  a  single  population ;  and,  further,  since,  in  the  main, 
American  white  adults  compete  with  American  white  adults,  this 
will  constitute  a  more  homogeneous  cultural  group  than  a  popula- 
tion of  negroes  and  whites.  The  same  argument  applies  though 
with  less  force  to  an  admixture  of  certain  other  races  in  the 
United  States,  especially  to  any  which  are  largely  concentrated  in 
particularly  limited  geographical  locations.  Southwest  Texas,  hav- 
ing many  Mexicans;  certain  valleys  in  California,  having  many 
Italians ;  Jewish  districts  in  New  York ;  German  districts  in  Mis- 
souri, are  not  all  fair  samples  of  American  white  population.  This 
matter  is  probably  not  of  great  importance  if  the  races  thrown 
together  all  have  the  same  mean  adult  measure  in  the  traits  con- 
sidered, but  it  becomes  of  prime  importance  where  this  is  not  the 
case.  It  would  be  desirable  in  a  future  study  of  traits  to  study  the 
racial  origins  of  each  and  every  individual  in  the  population  dealt 
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with — then,  if  a  critic  postulates  race  as  the  cause  of  any  of  the 
findings,  he  has  at  hand  the  means  of  testing  the  matter. 

Having  selected  a  group  to  work  with  the  problem  is  to  find  as 
many  as  possible  uncorrected  mental  traits.  The  uses  to  which 
such  information  could  be  put  are  innumerable.  Not  only  are  such 
data  sufficient  for  the  understanding  of  human  character,  but  they 
are  absolutely  necessary.  Let  us  suppose  that  musical  ability  and 
mathematical  ability  are  uncorrelated  and  suppose  we  have  a  test 
measuring  each  in  equal  proportion  and  yielding  a  single  score. 
Thus  if  a  child  scores  above  the  average  in  this  test  we  do  not 
know  whether  it  is  due  to  a  superiority  of  musical  ability  or  of 
mathematical  ability,  or  superiority  in  both.  Separate  scores  on  the 
two  traits  are  absolutely  necessary  if  a  correct  understanding  of 
the  child  is  to  result.  There  is  no  short  road  yielding  equally  valu- 
able information  at  less  labor,  and  any  trait  not  discovered  and  not 
separately  measured  will  always  be  a  scource  of  uncertainty  and 
confusion.  After  we  know  that  musical  ability  and  mathematical 
ability  are  independent  of  each  other  and  secure  reliable  measures 
of  each  but  (supposing  it  is)  do  not  know  that  memory  ability  is 
independent  of  each  of  the  other  two  and  secure  no  measure  of  it, 
we  will  with  reference  to  every  interest,  study,  vocation,  or  profes- 
sion, making  special  demands  upon  memory  ability,  be  groping  in 
the  dark.  In  other  words  there  is  no  substitute  for  knowledge 
concerning  this  specific  trait,  because  this  trait  is  independent  of 
the  other  traits  measured. 

Again,  if  we  have  knowledge  as  to  traits  which  are  correlated 
but  not  perfectly  with  each  other  the  possibility  of  correct  inter- 
pretation is  present,  but  the  difficulty  of  making  such  correct  judg- 
ments is  greatly  augmented.  Suppose  the  three  abilities  already 
mentioned  are  independent  mental  traits  and  that  we  have  three 
measures,  A,  B,  and  C,  such  that  A  is  50  per  cent  musical  ability, 
25  per  cent  mathematical  ability,  and  25  per  cent  memory  ability ; 
that  B  is  25  per  cent  musical  ability,  50  per  cent  mathematical 
ability,  and  25  per  cent  memory  ability ;  and  that  C  is  25  per  cent 
musical  ability,  25  per  cent  mathematical  ability,  and  50  per  cent 
memory  ability.  The  correct  understanding  of  the  individual  is  no 
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longer  to  be  based  upon  scores  in  tests  as  before  (where  we  were 
able  on  the  basis  of  the  musical  ability  test  alone  to  define  the 
status  of  the  individual  in  music  with  reference  to  the  group  and 
similarly  for  the  other  two  traits),  but  upon  differences  between 
scores  in  tests.  Furthermore  the  differences  are  weighted  differ- 
ences and  the  determination  of  the  weightings  is  none  too  easy  a 
task,  nor  is  their  use  after  determination.  The  advantages  of 
measures  of  traits  which  are  independent  of  the  other  traits  in- 
volved are  so  great  for  all  problems  of  guidance,  classification,  and 
education  that  they  are,  in  truth,  at  the  foundation  of  a  new 
psychology  which  the  future  is  to  build. 

It  ordinarily  happens  that  tests  as  drawn  up  are  of  the  nature 
of  the  tests  A,  B,  and  C,  each  measuring  more  than  a  single  mental 
function.  The  problem  is  then  twofold :  first,  a  determination,  hav- 
ing tests  A,  B,  and  C,  of  what  the  independent  mental  traits  are ; 
and  secondly,  an  experimental  construction  of  new  tests  measuring 
these  independent  traits.  This  latter  has  not  been  accomplished 
in  any  real  or  completely  satisfactory  manner  in  the  experimental 
investigation  here  described,  and  remains  a  larger  problem  to  be 
solved  in  the  future.  The  present  study  does,  however,  make  con- 
siderable progress  in  throwing  light  upon  the  first  phase,  and  thus 
it  paves  the  way  for  the  next  step.  We  may  now  turn  to  the 
mathematical  treatment  which,  given  such  tests  as  A,  B,  and  C, 
enables  us  to  ascertain  whether  one  or  more  underlying  traits  are 
present. 


CHAPTER  III 

THEORY  AND  STATISTICAL  TECHNIQUE 

This  chapter  is  devoted  to  proving  certain  basic  propositions 
and  to  deriving  several  much-needed  formulas  for  probable  errors. 

Proposition  1. — A  number  of  traits  greater  than  1  may  be  in- 
volved in  the  correlation  between  two  mental  measures,  no  matter 
what  the  value  of  the  correlation  coefficient. 

To  prove  this  it  is  only  necessary  to  show  that  it  is  possible  to 
conceive  of  two  independent  variables  underlying  the  two  measures 
which  are  correlated.  Let  xx  equal  the  score  of  an  individual  in 
Trait  1  as  a  deviation  from  the  group  mean,  and  let  o1  be  the  stand- 
ard deviation  of  such  scores.  Let  x2  equal  the  score  of  an  individual 
in  Trait  2  as  a  deviation  from  the  group  mean,  and  let  o2  be  the 
standard  deviation  of  such  scores.  When  further  variables  are  in- 
volved x3,  o3,  Xi,  <j4,  etc.,  are  defined  in  a  similar  manner.  Let  r12 
equal  the  product-moment  correlation  between  xx  and  x2.  Let  us 
divide  x2  into  two  parts  thus : 

X2  =  t-i-^i      I      ^1^2 

a  part  which  is  perfectly  correlated  with  xlf  namely,  c1x1 ;  and  a 
part  which  has  zero  correlation  with  xx,  namely,  c^e2.  Let  us  under 
these  conditions  ascertain  the  numerical  limits  in  the  values  of  r12. 
The  quantities  xx  and  e1  are  variables,  and  cx  is  a  numerical  con- 
stant lying  between  the  limits  ±  o2/olf  for  the  extreme  values  that 
c1  can  take  exist  when  oea  =  0.  In  this  case 

C-tX-,    =   Xn 


Cl=±ll 

For  the  correlation  between  x1  and  x2  we  have 

_  ^2x1(c1x1  +  c1e2)  _  a\Cj  _  c^ 
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The  largest  value  for  r12  is  found  when  cx  =  <s2/ox.  In  this  case 
r12  =  1.  The  smallest  value  is  found  when  cx  =  -o2/o1  and  then 
r12  =  -l.  Accordingly,  whatever  the  value  of  r12  we  may  think, 
if  we  so  desire,  of  the  correlation  as  due  to  not  over  two  independ- 
ent traits.  The  two  independent  traits  which  we  chose  in  the  illus- 
tration were  xx  and  e2.  We  might  have  interchanged  the  variables, 
choosing  x2  and  e1.  Of  these  two  independent  traits  one  is  one  of 
the  two  measured  traits.  Thus  it  is  always  possible,  if  no  further 
information  than  the  coefficient  of  correlation  between  two  vari- 
ables is  known,  to  look  upon  the  correlation  as  due  to  two  independ- 
ent traits.  It  frequently  is  not  desirable  so  to  do.  This  is  especially 
the  case  when  it  is  known  that  a  part  of  each  of  the  two  variables 
is  chance.  Suppose  a  situation  in  which  the  variables  may  be  written 

*X  =  -roo  +  *i 
X 2  —  Xw  -p  €2 

in  which  x1  is  the  obtained  score  in  the  first  trait,  x2  in  the  second 
trait ;  x^  the  true  score  in  the  first,  xw  in  the  second ;  and  ex  the 
chance  factor  entering  into  the  measure  of  the  first  trait,  and  e2  the 
chance  factor  entering  into  the  measure  of  the  second  trait.  This 
situation  parallels  many  actual  experimental  situations.  It  is  no 
longer  desirable  to  think  of  the  correlation  between  xx  and  x2  as 
due  to  two  independent  measures,  for  one  of  these  measures  would 
involve  as  a  part  of  itself  a  purely  chance  element.  It  may,  however, 
be  desirable  to  think  of  the  correlation  between  xx  and  x„  as  due 
to  two  independent  measures,  let  us  say  xx  and  that  part  of  xv  that 
is  independent  of  xx.   We  may  call  it  xT.   Then 

Xx  =  ^"oo  "T"  6\ 

X 2  =  C2X 'oo  -p  Xj  -p  62 

in  which  Xco,  elf  xT,  and  e2  are  independent  variables.  Obviously 
following  from  the  preceding  proof  it  is  always  possible  to  interpret 
the  correlation  between  two  variables  in  this  manner ;  that  is  to 
say,  the  correlation  may  be  thought  of  as  due  to  four  independent 
variables,  two  of  which  are  chance,  and  one  of  which  is  that  part  of 
one  of  the  measures  which  is  not  chance  and  which  is  not  corre- 
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lated  with  the  true  part  of  the  other  measure.  Statistically  there 
is  no  means  of  differentiating  between  xT  and  e2  unless  some  other 
measure,  say  x3,  enters  into  the  problem,  for  e2  correlates  with 
neither  X&  nor  elt  and  xT  likewise  correlates  with  neither  of  these. 
If  we  look  to  further  variables  than  xlf  x2  as  a  means  of  differ- 
entiating between  x^  and  ev  or  between  xa  and  e2,  or  between  xT 
and  e2,  we  can  readily  find  the  necessary  two  added  variables  to 
enable  us  to  do  so.  Let  us  call  Xi  a  measure  of  the  same  thing  that 
xx  measures,  and  let  us  say  that  the  method  of  derivation  of  xt  as- 
sures us  that  it  is  a  measure  equal  in  excellence  to  xx.  Then  we 
may  write 

Xj  ==  Xqq  "T"  »j 

in  which  x^  is  the  identical  measure  entering  into  the  right-hand 
member  of  the  equation  giving  xx,  and  in  which 

Oej  =  0ei 

thus  giving  az  =  ax 

and,  further,  for  the  correlation  between  xx  and  x,  we  have 

_  SQoo  +  gi)  Ooo  +  ei)  _  o^  1-3-1 

Since  o2x  =  o2^  +  a2ei,  we  immediately  obtain 

^=l-ru [4] 

Thus,  though  we  have  not  separated  for  each  individual  the  x^ 
and  e1  factors, we  have  for  the  group  fully  determined  how  much  of 
the  variance  is  representative  of  the  real  underlying  trait  and  how 
much  of  it  is  due  to  chance.  If  the  total  variance  is  o21  the  propor- 
tion due  to  chance  is  (1—  ru)  and  the  portion  due  to  a  real  trait 
is  ru. 

If  x„  is  a  second  measure  similar  to  x%  we  may  determine  ofl  in 
a  manner  similar  to  that  which  gave  us  o(V  Thus,  knowing  o2x>/o21 
and  G2eJo22  we  immediately  find  o2T/o22.  The  steps  are 
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2  ( x^  -f  ^ )_ ( c.x^  +xT  +  e») 
1 

(o0O)(c2o0O) 


Tl2  -  No.o 


o. 


r2  a* 
r2//_      a22      "^0% 

^!l_r        _J^«      [5] 

°    2  '  1/ 

In  this  text,  when  the  expression  "the  proportion  of  a  variable 
clue  to  chance"  is  used,  it  means  the  ratio  o2ei/o21.  More  accurately 
stated  this  is  the  proportion  of  the  variance  of  the  variables  that  is 
to  be  attributed  to  chance,  for  this  proportion  will  presumably  not 
hold  for  any  particular  individual  whose  score  might  be  under  con- 
sideration. 

An  interesting  situation  which  not  uncommonly  arises  exists 
when  o2T  equals  zero.  Professor  Spearman  found  this  to  be  the 
case  so  commonly  that  it  led  to  his  general- factor  theory,  which  is 
that  any  intellectual  activity  may  be  thought  of  as  due  to  a  single 
factor  underlying  this  and  all  other  intellectual  activities  plus  a 
factor  specific  to  the  trait  in  question  and  not  found  in  any  other 
but  closely  allied  traits.  If  Spearman  had  omitted  the  idea  repre- 
sented by  italics,  leaving  the  interpretation  in  fact  erroneously  at- 
tached by  the  present  writer  and  certain  others  to  Spearman's  early 
wording  of  the  theory,  the  proof  of  the  inadequacy  of  the  theory  to 
fit  many  facts  of  inter-correlation  of  mental  tests  would  have  been 
in  general  quite  simple.  Including  the  part  italicized  the  theory  is 
quite  impregnable  because  just  as  soon  as  certain  tests  do  not  give 
correlations  which  can  be  adequately  explained  by  a  single  factor 
plus  specific  factors,  then  it  may  be  said  that  some  of  the  tests  are 
measures  of  "closely  allied  traits."  The  writer  therefore  does  not 
set  himself  the  task  of  proving  or  disproving  Spearman's  general- 
factor  theory    (also  called  Spearman's  theory  of  two  factors — a 
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general  factor  and  a  specific  factor),  but  rather  the  quantitative 
problem  of  determining  what  mental  traits  are  such  that  a  single 
factor  is  sufficient  to  explain  the  correlations  holding  throughout, 
and  what  mental  traits  demand  for  their  adequate  explanation  two 
or  more  general  factors.  We  will  first  investigate  the  correlation 
conditions  which  must  hold  if  a  single  general  factor  is  sufficient  to 
account  for  the  correlation  between  two  variables. 

Proposition  2. — One  general  trait  plus  factors  specific  to  each 
of  two  variables  is  always  sufficient  to  account  for  the  correlation 
between  two  variables,  no  matter  what  its  numerical  value. 

Let  the  gross  score  in  the  first  measure  be  Xx.  Let  this  be  a 
function  of  a  trait  A  also  present  in  X2,  and  of  a  trait  Ex  not  found 
in  X2.  Then  we  may  write 

Xt  =  f  (AXEX)  [6] 

Now  if  Mx  is  the  mean  of  the  X's  for  the  population  in  question; 
Ma  the  mean  of  the  A's ;  Me±  the  mean  of  the  E's,  let  us  write 

Xl  =  Xx-Mt    [7] 

a  =A—Ma [8] 

e  =  (Ex  —  Mei)  times  some  constant.  .  [9] 

If  A7-!  is  some  trait,  such  for  example  as  computation  ability,  which 
grows  in  the  single  individual  from  time  to  time  and  changes  from 
individual  to  individual  in  an  essentially  homogeneous  group  in  a 
manner  not  markedly  saltatory,  and  if  Mx  does  not  approximate 
zero,  i.e.,  is  not  small  with  reference  to  alf  then  Taylor's  Series  may 
be  employed,  yielding 

x1  =  cxa  +  ex    [10] 

in  which  c,  is  some  constant  not  changing  as  we  pass  from  member 
to  member  of  the  group  in  question.   Likewise 

x2  =  c2  a  +  e2 [See  10] 
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The  specific  factors  are  e1  and  e*.  The  common  factor  is  a.  The  in- 
dependent variables  a,  elt  and  e2  are  uncorrelated,  and  cY  and  c2  are 
constants.  We  may  set  oa  =  1  without  any  loss  in  generality  be- 
cause c1  and  c2  are  still  at  our  option.  It  is  easily  shown  that 

^2  =  — — —  =  «!a2 [11] 

oxo2 

where  the  as  are  defined  by  the  equations 


<:2oa 


[12] 


and  it  is  immediately  obvious  that  the  limits  of  either  a  are  ±  1,  so 
that  the  limits  of  a21  or  cr2  are  zero  and  1.  The  quantity  a^  will 
be  referred  to  as  a  variance — it  is  the  proportion  of  the  total  vari- 
ance, o21,  due  to  the  factor  a.  We  may  write 


r-,9  =  or-,  cr 


Substituting  the  lower  and  upper  limits  we  find  that  r212  must  lie 
between  zero  and  1,  i.e.,  it  may  take  any  value.  Our  conclusion 
therefore  is  that  no  matter  what  the  value  of  r12  it  is  conceivable 
that  it  was  consequent  to  two  variables  having  one  general  factor 
and  specific  factors.  This  statement  substantiates  Proposition  2, 
and  it  further  shows  that  it  would  be  entirely  futile  to  attempt  to 
test  Spearman's  general-factor  theory  by  means  of  a  two-variable 
problem.   We  must  concern  ourselves  with  at  least  three  variables. 

Proposition  3. — Three  variables  may  be  thought  of  as  due  to  a 
single  general  factor  plus  one  specific  factor  only  in  case  two  of  the 
variables  are  perfectly  correlated} 


1  The  statement  of  this  and  subsequent  propositions  would  be  more  ac- 
curate if  preceded  by  the  words  "judging  from  the  inter-correlations  only." 
Since  in  this  study  all  conclusions  reached  are  based  upon  product-moment 
correlation  coefficients,  this  phrase  is  omitted  for  the  sake  of  conciseness. 
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Let 

x1  =  c1a 

x2  ==  c2a 

x3  =  C3a  -f-  e3 ', 

then  a2x  =  1 ;  a22  =  1 ;  and  r\2  =  a2x  a22  =  1.  Thus  proving  the 
proposition. 

Proposition  4. — Three  variables  may  be  thought  of  as  due  to 
a  single  general  factor  plus  two  specific  factors  only  in  case  the 
product  of  two  of  the  three  inter-correlations  is  equal  to  the  third. 

Let 

xx  =  cxa 

x 2  ~~  c2a  "T"  ^2 
x3  —  c3a  +  e3 ; 

then  a2x  =  1 ;  r12  '=  c^a, ;  r13  —  axa3 ;  r23  =  a2a3.    Therefore, 

^12^13  =  ^23     t13] 

or 

r12  W^m  =  1    t14l 

This  establishes  the  theorem.  That  this  criterion  may  be  serviceable 
we  require  the  probable  error  of  the  function  r12  r13/r23.  It  is  de- 
rived herewith. 

Let 

/  =  ris  ri3 [15] 


r 


23 


Taking  logarithmic  differentials  we  have 

df  _dr12      dr13      dr2 

T  r\2  ^13  r2Z 
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Squaring  and  summing  and  dividing  by  the  population  gives 

°2f    _°2r13     ,<*2r,3     .O2^      i     2cria  Ori3 

X2      ' —  ~~2         "I         2         "■         2  '  'I'll  fl! 

T"  ^12  ^13  ^23  '12  ^13 

_2or12_Or?i  _  2ar,3  Gri3 

'12  '23  '13  '23 

The  formula  for  the  correlation  between  correlation  coefficients 
(see  Formula  128  of  Kelley,  Statistical  Method)  may  be  utilized  to 
reduce  this  to  an  expression  involving  r12,  r13,  r28,  and  N,  the 
population.  The  resulting  expression  does  not  greatly  simplify,  and 
as  the  values  of  (NaritOriarriaria)  are  fairly  readily  obtained  by 
Formula  66,  it  is  easier  to  reduce  the  standard  error  to  the  follow- 
ing form  and  use  Formula  66. 

+  2  O  —  r2i2)  (1—  r2i3)  rri2r13   _    ( l—^i3)  ( 1— r223)  fyMra 
r%2  r13  r13  r2Z 


(1—^12)  Q— »-%,)*>„  rM]* [16] 


"  '  .  23  )   'ri3  r„,   1  " 

ri2  r23  J 

Proposition  5. — Three  variables  may  be  thought  of  as  arising 
from  one  general  factor  plus  three  specific  factors  wJien  the  abso- 
lute value  of  the  product  of  every  tivo  of  the  three  intcr-corrclations 
is  less  than  the  third  and  %vhen  one  or  three  of  the  inter-correlations 
are  positive. 

Let 

x1  =  cxa  +  ex 

x2  =  c2a+e2       [■  [Sec  10] 

x,  =  c*a  -f-  e3 
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in  which  as  before  a,  elf  e2,  and  e3  are  uncorrelated.   We  will  let 

CxGa 


c2oa 

CsOa 


=  a. 


=  a, 


=  a. 


[See  12] 


It  is  readily  found  that 


axa2 
a,  a, 


[See  11] 


We  may  solve  these  three  equations  for  alt  a2,  a3  as  follows : 


a\  = 

'  11  '13 
^23 

a\  = 

^12  ^23 

rt2-  _ 

^13  ^ 23 

[17] 


Since  the  part  of  the  first  variable  which  is  specific  to  the  first 
variable,  namely,  e1}  is  not  included  in  cxa  it  is  obvious  that  cxaa 
is  always,  in  absolute  value,  less  than  oa.  Thus  arlt  as  well  as  a22 
and  a23,  lies  between  the  limits  zero  and  1.  Whenever  the  last  three 
equations  yield  positive  values  less  than  1  for  a2u  a22,  and  a23  then 
the  three  variables  xlt  x2,  and  xz  may  be  thought  of  as  composed  of 
one  general  factor  plus  specific  factors.  The  variances  a21(  a22,  and 
a23  will  lie  between  zero  and  1  when  the  quotients  are  positive 
and  the  numerators  less  than  the  denominators.    This  establishes 
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Proposition  5  as  stated.  These  are  very  easy  conditions  to  meet.  In 
other  words  there  is  a  wide  range  within  which,  judged  by  the  cor- 
relations yielded,  three  variables  may  be  conceived  of  as  consequent 
to  one  general  factor  plus  specific  factors.  The  main  value  of 
Proposition  5  is  as  a  means  of  quickly  finding  three  variables  which 
differ  widely  one  from  another.  In  order  to  be  certain  of  a  judg- 
ment in  cases  where  a21;  a22,  and  a23  differ  slightly  from  zero  we 
should  use  the  probable  error  of  this  quotient  as  already  derived  in 
Formula  16. 

As  Proposition  5  is  only  occasionally  useful  we  need  a  require- 
ment which  is  more  difficult  to  fulfil.  When  may  three  variables 
be  thought  of  as  consequent  to  two  independent  general  factors 
plus  no  specific  factors? 

Proposition  6. — Three  variables  may  be  thought  of  as  due  to 
two  independent  general  factors  and  no  specific  factors  when  the 
multiple  correlation  coefficients  r-y.23,  r2.13,  r3.12  are  each  equal  to  1. 

It  may  readily  be  shown  that  these  conditions  are  met  when 

1  +  2r12  r13  r23  —  r\2  —  r\3  —  r\3  =  0 [18] 

Equation  18  is  accordingly  the  required  condition.  We  will  prove 
it  herewith :  Let 

x-y  =  c^a  +  kxb 
x2  =  c2a  -f-  k2b 
x3  =  c3a  -f  k3b 

Eliminating  a  and  b  from  these  three  equations  will  give  us  a  linear 
equation  in  xlf  x2,  and  x3.  Thus  any  one  of  these  three  variables 
may  be  determined  from  a  knowledge  of  the  other  two.  This  is 
equivalent  to  the  statement  rx.m  =  ±1 ;  r2.13  =  ±1;  r3.12  =  ±  1. 

The  condition  as  stated  is  practically  never  met  by  raw  correla- 
tion coefficients  and  the  reason  is  undoubtedly  due  to  the  presence 
of  specific  or  chance  factors  in  variables  xlf  x2,  and  .r3.  As  apply- 
ing to  raw  correlation  coefficients  this  is  not  a  valuable  criterion 
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and  its  probable  error  has  not  been  calculated.  If  we  apply  this 
test  not  to  raw  coefficients  of  correlation  but  to  those  corrected  for 
attenuation  we  eliminate  as  far  as  possible  the  chance  factor.  If 
Xqo,  xu,  and  xr  are  the  true  scores  of  individuals  whose  obtained 
scores  are  xlt  x2,  and  x3,  then  xx,  xu,  and  xT  may  be  thought  of  as 
consequent  to  two  general  factors  only  when 

1     i     ^oow  roor  TWT         r  oow  Y  OCT         '"4,T=U \X*\ 

The  probable  error  of  this  expression  has  not  been  calculated  and 
this  test  therefore  has  not  been  used  in  the  present  study.  It  may, 
however,  prove  a  valuable  aid  as  soon  as  its  probable  error  is  known. 

Proposition  7. — Three  variables  may  always  be  thought  of  as 
due  to  two  general  factors  plus  one  specific  factor. 

Let 

x1  =  cxa  +  k-Jy  +  e1 

x2  =  c2a  +  k2b 

x3  =  c3a  +  k3b 

Let  us  call  (x1  —  ex)  a  new  variable  and  designate  it  by  xA.  Then 
x\  =  cxa  +  kxb.  Dealing  with  x2,  x3,  and  x4  the  condition  laid  down 
in  the  preceding  proposition  must  hold  if  the  three  variables  x2,  x3, 
and  x4  are  to  be  thought  of  as  due  to  two  general  factors.  We  thus 
have 

i  -\-  £r2i  r3i  r23      r  2±      ^  3i       r  23  =  u 

We  must  obtain  a  relation  between  r2i  and  r3i  and  the  known  values 
r12  and  r13.  In  addition  to  the  a's  as  already  defined  let  us  here  de- 
fine |3X  and  (3.,  as  follows : 


ft  k^Oh 

Q  k2Ob 

?2=  —r- 


[20] 
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It  is  readily  shown  that  r12  =  c^o,  -f-  p\p\>,  and  r24  =  a2a4  -f-  p\{34. 
Since 

and  a4  ==  £i^ 

therefore  a4  =  ax  ^i . 


Similarly  fa  =  fa  Si . 


This  yields 


Similarly 


r24=(a1a2  +  fafa)?±  =  r12?± [21] 

a.  a. 


r34  =  r13A [SV<?21] 


Substituting  values  for  r24  and  r34  just  found  we  obtain 

o  4  r  12  ~r  ^"13  —  2r12  r13  r23  r??l 

°2i  ~  1  —  r223 

Since  0^^  must  lie  between  0  and  1  the  required  criterion  is 

0<r2i2  +  r213^-2r12r13r23<1 ^ 

*  ^23 

As  the  denominator  is  always  positive  the  expression  can  be  less 
than  the  lower  limit  only  in  case 


1 2r12  r13  r23 1  >  I  r\2  +  r\3 1 
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This  is  never  possible  for 

| r\2  +  r\3 1  >  |  2r12  rin\^>\ 2r12  r13  r23 1 

Now  let  us  consider  the  upper  limit.   For  the  expression  to  exceed 
the  upper  limit  is  equivalent  to  the  following  statement. 


r   12  "T"  f~l3  ^12  ^13  r 


1  —  r2 


1>0 


This  in  turn  can  only  hold  if 

r\2  +  r\3  +  r223  —  2r12  ria  r23  —  1  >0 

But  Yule  has  shown  (1912)  that  this  is  never  possible.  Accordingly 
we  have  proved  Proposition  7.  The  next  two  propositions,  of 
course,  follow  without  proof. 

Proposition  8. — Three  variables  may  always  be  thought  of  as 
due  to  two  general  factors  plus  two  specific  factors. 

Proposition  9. — Three  variables  may  ahvays  be  thought  of  as 
due  to  two  general  factors  plus  three  specific  factors. 

If  specific  factors  are  present,  and  they  always  are  even  if  they 
constitute  nothing  more  than  the  chance  elements  entering  into  a 
score,  the  need  for  more  than  two  general  factors  can  never  be 
established  by  the  study  of  three  variables  only.  This  finding  is  of 
importance  as  it  defines  our  study  as  a  four-or-more-variable  in- 
vestigation. The  crux  of  the  study  devolves  upon  propositions 
dealing  with  four,  with  five,  and  with  a  still  larger  number  of  vari- 
ables. The  basic  relationship  used  by  Spearman  and  first  devised 
by  him  is  that  given  in  the  next  proposition. 

Proposition  10. — Four  variables  may  be  thought  of  as  due  to 
one  general  factor  plus  four  specific  factors  when 

riZ  ^*34  —  ri3  r2i  =  riA  r23 L^"J 
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[25] 


Still  another  way  is  to  say  that 


^12  ^34 

—  r18  r2i  =  0 

^12  ^34 

^14  ^23  =  ** 

^13  ^24 

-  ri4  r2Z  =  0 

[26] 


Spearman,  who  first  derived  these  equations,  has  called  such  differ- 
ences as  these  "tetrad  differences."  The  term  is  used  throughout 
the  present  treatment  and  the  following  abridged  notation  em- 
ployed : 

'l  2  3  4  =  ^12  ^34  ^13  ^2 

'  1  2  4  3  —  r\2  r2i  ri4  r2 

►l      Q    A    O     '    1  Q    '    Oi     ~~~ '     '    1  A     '    O 


[See  1] 


14  '  23 

*1  3  2  4  ==  ^13  ^24  ^12  ^34 

*1  4  2  3  ==  ^14  ^23  ^12  ^34 

'l  4  3  2  =  ^14  ^23  **13  ^24 


The  last  three  tetrads  are  merely  the  first  three  with  the  signs  re- 
versed. Only  two  of  the  six  are  independent,  so  that  there  are  two 
conditions  to  be  met.  The  reader  should  note  that  the  third  sub- 
script of  a  t  is  the  second  subscript  of  the  third  r  appearing  in  the 
tetrad  difference.  Having  noted  this  the  entire  tetrad  difference 
may  be  written  down.  We  will  now  prove  Proposition  10. 
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xt  =  cxa  +  e1 

x2  =  c2a  -f-  e2 
xz  =  c3a  -[-  e3 
x±  =  c4a  +  <?4 


[See  10] 


Defining  a1}  a2 


as  before,  it  readily  follows  that : 
r12  =  at  a2 

r13  =  <h  as 
r14  =  cti  a4 

r23  =  a2  a3 
r24  ==  a2  a4 
raA  =  a,  at 


[See  11] 


From  this  we  immediately  obtain  : 


»ia  r34  =  r13  r2i  =  rM  r23  =  c^  a2  a3  a4 


[27] 


This  establishes  "the  sufficiency  of  the  equality  of  the  tetrad  differ- 
ences with  0  to  enable  one  to  think  of  four  variables  as  being  con- 
sequent to  one  general  factor  plus  four  specific  factors.  We  may  at 
this  point  state  the  converse  proposition.  //  a  tetrad  difference  does 
not  equal  0,  two  or  more  general  factors  plus  specific  factors  are 
necessary  to  account  for  the  inter-correlations  between  the  four 
variables.  This  converse  proposition  is  almost  certainly  true  so  long 
as  linear  regression  only  is  involved. 

We  must  now  obtain  a  formula  giving  the  probable  error  of  the 
tetrad  difference.  The  writer  has  used  since  1922  a  formula  yield- 
ing the  standard  error  of  the  tetrad  quotient,  r12  r34/r13  r2i,  but  he 
has  recently  been  converted  to  the  use  of  tetrad  differences  instead 
(in  part  because  Spearman  uses  them)  and  he  has  derived  a  stand- 
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ard  error  formula  for  the  same.  Spearman  and  Holzinger  (1925) 
also  have  a  formula  for  the  probable  error  of  a  tetrad  difference, 
but  as  their  formula  gives  the  probable  error  in  case  the  true  differ- 
ence is  equal  to  0  the  writer  prefers  his  own  slightly  longer  for- 
mula, for  the  latter  does  not  depend  upon  the  true  value  of  the 
difference  being  equal  to  0.  In  passing,  it  may  be  stated  that  the 
writer's  formula  reduces  to  that  of  Spearman  and  Holzinger's  when 
the  true  tetrad  difference  does  equal  0,  so  that  there  is  no  inconsist- 
ency between  the  two  formulas.   We  have: 

^1  2  3  4  ==  *12  ^34  ^13  ''24 

'1234  +  A1234  =  (r12  +  A12)  (r34  +  A34)  —  (rls  +  A13)  (r24  +  A24) 

Expanding  and  subtracting  t123i  from  each  member  and  neglect- 
ing second  degree  terms  in  the  A's,  since  they  are  of  an  order  1/y/N 
to  the  first  degree  terms  and  thus  small  if  N  is  appreciable,  we  have 

A1234  =  A12r34  +  A34r12  —  A13r24  —  A24r13 

Squaring,  summing,  and  dividing  by  the  population  yields 
"2(1)J(  =  o2r1,^234  +  ov,4  r212  +  o2,-13  r224  +  a2rM  r213 

+  2  (<trlt  >'34  Or„  >'i2  r>12  r3l  +  Or13  f24  G,w  ri3  rru r*  ~  Or»  r34Cri3  T2irri2  r„ 
Qri2  r34Gr24  ris^r12  rM  Or3t  T12  a,,3  K24  tru  ru  Gr^  f12  GrM  f13  Tru  ru ) 

Utilizing  Filon  and  Pearson's  formulas,  numbers  127  and  128  of 
Kelley,  Statistical  Method,  for  the  correlation  between  correlation 
coefficients  and  the  usual  formula  (1  —  r2)/\/N  for  the  standard 
error  of  a  correlation  coefficient  enables  one  to  reduce  the  preced- 
ing to 

—  02i2  +  ^i3  +  »*24  +  **u  +  2r12  r14  r23  r34 


+  2riz  r14,  r23  r24  —  2r12  r18  r23  —  2r12  r14  r24  -  2r13  ru  r34  —  2r23  r24  r3 
+  *".„«0*u  +  r\3  +  r214  +  r223  +  r224  +  r234  -4)]* [28] 
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Though  a  number  of  abridgments  to  this  value  of  a(l234have  been 
investigated,  none  give  close  enough  approximations  to  this  full 
value  to  recommend. 

Proposition  11. — Four  variables  may  be  thought  of  as  due  to 
one  general  factor  plus  three  specific  factors  when  the  product  of 
the  three  inter-correlations  involving  three  of  the  variables  is  equal 
to  the  square  of  the  product  of  the  other  three  inter-correlations. 
(A  more  accurate  statement  of  the  sufficient  condition  is  found  at 
the  end  of  the  next  paragraph.) 

When  four  variables  give  two  tetrads  which  are  each  equal  to  0 
within  the  limits  of  their  probable  errors,  it  may  then  be  desirable 
to  ascertain  what  is  the  nature  of  the  one  common  function.  The 
four  variables  each  possess  this  common  factor  plus  four  specific 
factors,  so  that  by  studying  variable  1,  which,  let  us  say,  is  a  certain 
psychological  test,  one  does  not  know  whether  the  mental  tasks 
which  he  finds  involved  therein  are  representative  of  the  common 
factor  or  of  the  specific  factor.  He  may,  however,  obtain  much 
light  upon  this  if  the  score  on  a  second  similar  form  of  this  Test  1 
is  available.  On  page  38  we  let  x1  =  c1  a  +  e1}  wherein  ex  was  a 
factor  specific  to  Test  1.  Let  us  here  divide  er  into  two  parts, 
ex  =  b  +  d,  in  which  &  is  a  factor  specific  to  Test  1  but  not  chance, 
and  d  is  the  chance  factor  specific  to  Test  1,  then  xx  =  cx  a  +  b  +  d. 
For  the  second  similar  form  of  this  test  we  have 

Xj  =  c1  a  +  b  +  D 

in  which  cx  a  and  b  are  identical  with  cx  a  and  b  in  form  1,  but  in 
which  for  any  individual  D  is  a  chance  factor  entirely  unrelated  to 
the  chance  factor  d.  If  we  correct  all  correlations  involving  vari- 
able 1  for  attenuation  (for  variable  1  only)  we  eliminate  the  sys- 
tematic effect  of  the  chance  factor  d  but  not  the  effect  of  the 
specific  factor  b  and  thus  the  correlations  corrected  for  attenuation 
(for  variable  1  only)  are  those  between  the  following  sets  of  vari- 
ables. The  quantity  ca  a  +  b  becomes  the  first  variable  and  this  we 
will  designate  by  #«, ;  the  second  variable  is  x2,  the  third  is  xs,  and 
the  fourth  is  x4.  The  correlations  are  rX2,  *\»3>  r<»4»  rz%>  r2*>  rm-  If 


THEORY  AND  TECHNIQUE 


51 


x1  is  such  that  it  has  no  factor  b,  being  in  truth  composed  merely 
of  the  general  factor  cxa  and  a  chance  factor,  we  could  then,  of 
course,  carefully  study  Test  1,  attempt  to  eliminate  from  our  con- 
cept of  it  such  features  as  are  chance,  and  secure  a  residuum  that 
is  cx  a  and  nothing  else.  If  there  is  no  factor  b  entering  into  Test  1 
we  may  write  .x\  =  c^a  +  d  and  X&  =  cxa,  using  x^  in  place  of  x1 
and  paralleling  the  steps  involved  in  the  proof  of  the  last  proposi- 
tion we  obtain 

-roo  =  cxa 
x2  =  c2a  -f  e2 
x%  =  cza  +  e3 
*i  =  Cia  +  e4 


r*,,  =  a, 


r,.  =  a,a. 


a,a, 


fnOA  =  a-« 


t%.  =  a,a. 


" 002    '003    1 

'002    '004   '  1 

'003   '  004    '  3 


002    '      003    '      OC4 


23   '  24  '  34 


[29] 
[30] 


If  Equations  29  and  thus  as  a  consequence  Equation  30 
hold,  we  know  that  all  of  Test  1  except  that  part  of  it  that  is 
chance  is  the  general  factor.  The  formulas  giving  the  probable 
errors  of  O^r^  —  r,3),  (rW2  rW4  —  r24),  (r^  rxi  —  r34),  and 
(•K2oo2r2oo3-K2oo4  —  r23r24r34)  have  not  t>een  derived  so  that  this 
criterion  is  not  of  immediate  practical  value.  The  relationship 
stated  in  Formula  30  is  a  necessary  but  not  a  sufficient  condition. 
The  sufficient  requirement  is  that  the  three  equations  [29]  hold. 
It  is  conceivable  that  Formula  30  might  hold  without  all  three  of 
these  holding,  though  this  is  improbable  in  view  of  the  likelihood 
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of  the  left-hand  member  falling  short  and  not  exceeding  the  right- 
hand  member  in  each  of  the  equations  in  [29] . 

Proposition  12. — Four  variables  may  be  thought  of  as  due 
to  two  general  factors  and  four  specific  factors  when  a  value 
a2x  ^L  0  and  =  1  can  be  found  such  that 

r>  <^    Va"l  ^24  ^12  ru)    \a  1  ^23  ^12  ^13 )  <^   i  r-ji  l 

=  a2,  (a2,  r34  —  r13r14)  = 

and  when  every  similar  function  obtained  by  permuting  the  vari- 
ables is  satisfied. 


Let 


xx  =  CXA  +  KXB  +  ex 

x2  =  C2A  +  K2B  +  e2 
x3  =  C3A  +  K3B  +  e3 
x.  =  C.A  +  K.B  +  <?. 


[32] 


in  which,  as  before,  Oa  =  0s  =  1  and  ^  -^  fi>  ^2»  ^3>  and  ei  are 
uncorrelated.  In  place  of  the  variables  A  and  B  it  will  prove  con- 
venient to  rotate  the  axes  using  new  variables  a  and  b  defined  by 
the  equations 

A  =  a  cos  $  —  b  sin  ft 
B  =  a  sin  ft  +  b  cos  ft 

The  new  variables  a  and  &  are  uncorrelated  as  were  by  hypothesis 
A  and  B,  for  we  have 

a  =  A  cos  ft  +  B  sin  ft 
&  =  —  A  sin  ft  +  5  cos  ft 

2a&  =  2(^cosft  +  5sinft)  (-  A  sin  ft  +  5  cos  ft)  = 

—  sin  ft  cos  ft  2A*  -f  cos2  ft  2AB 

-  sin2  ft  2.AB  +  sin  ft  cos  ft  252 
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which  equals  zero  since  the  "2AB  =  0  and  since  1>A2  ==  252.  Mak- 
ing the  indicated  substitutions  for  A  and  B  we  have 

x1  =  Cxa  cos  ft  —  C\fr  sin  ft  +  iv  jO  sin  ft  -f-  i^fr  cos  ft  +  c1 

=  (dcosft  +  i^  shift)  a+  (A^  cosft  —  C\  sinft)  fc  +  ^ 

Since  there  is  no  limitation  upon  ft  let  us  choose  such  a  value  of  ft 
that 

Kt  cos  ft  —  d  sin  ft  =  0 

and  let  us  designate  (C\  cos  ft  +  Kx  sin  ft)  by  the  symbol  c1.  Then 
we  have 

x\  —  c\  a  +  ci [See  10] 

Making  the  same  substitution  in  the  equations  giving  x2,  x3,  and  x4 
and  designating  the  constants  which  multiply  the  two  variable  gen- 
eral factors  by  lower-case  letters  we  have 


x2  =  c2a  +  k2b  -\-  e2 
x3  =  c3a  +  k3b  +  c3 
xA  =  c4a  +  k.b  -f  e. 


[See  32] 


This  set  of  four  equations  in  which  kx  =  0  defines  xlf  x2,  x3,  and  x4 
with  as  much  generality  as  the  first  set  of  four.  We  may  state  the 
following  proposition,  derived  incidentally  in  our  proof  of  Propo- 
sition 12. 

Proposition  13. — //  it  is  possible  to  express  four  variables  as 
due  to  two  general  factors  plus  four  specific  factors,  it  is  always 
possible  to  express  the  same  four  variables  as  due  to  two  general 
factors  one  of  which  runs  through  all  four  of  the  variables,  while 
the  other  one  runs  through  but  three  of  them,  plus  four  specific 
factors. 
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Let  us  call 

CjOa 


k2Ob 


=  a, 


=  P. 


c2oa 

°2 
<?3 


=  a, 


COn 


=  a, 


=  p3; 


k4Ob 


;  -i— ^  =  a4 . . . .  [See  12] 
P4 [S*<?  20] 

[33] 


r14  =  a,a 


1  "4 


r23  =  a,  a3  +  p\  fj3 

r24  =  a2a4  +  p\|34       [34] 

rZi  =  «3  «4  +  P3 134 
Eliminating  a2,  a3,  a4,  (33,  and  |34  from  these  six  equations  we  obtain 
( «2i  r23  —  r12  r13 )   ( a2x  r24  —  r12  r14 ) 


a2i  (aV34  — r13r14) 


=  P2 


[35] 


There  are  two  other  equations  of  this  type  involving  in  the  right- 
hand  members  (323  and  P24  and  the  same  a2x  in  their  left-hand 
members.  There  are  four  such  sets,  giving  12  conditions  in  all  to 
be  met.  Since  crx  and  |322  are  independent  and  since  each  lies 
between  0  and  1  we  have  the  proposition  as  stated. 

Dr.  Harold  Hotelling  has  kindly  provided  the  following  set  of 
necessary  conditions  which  are  more  readily  investigated  than  are 
the  12  sufficient  equations  in  Formula  35. 

Substituting  the  values  a2,  a3,  and  cc4  obtained  from  the  three 
equations  [33]  into  the  three  [34],  yields 


P2  P3  =  ''23  — 


r,J, 


P,.fc 


r,0r, 


PsP* 


>-,.  r, 
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Multiplying  these  three  equations  member  by  member  and  writing 
z  for  l/a2!  we  obtain 

P22p23P24=(>23— r12r13z)    (rM— riartis)    (r3i—r13r14z) 

=  /(*) [36] 

If  the  assumption  of  the  adequacy  of  two  general  factors  is  correct 
then  there  must  be  a  value  for  z  greater  than  1  which  will  give  a 
value  of  f(z)  lying  between  zero  and  1  inclusive.  The  coefficient 
of  z3  is  negative,  consequently  if  the  curve  y  =  f(z)  enters  the 
strip  s  >  1,  0  <  y  5*  1,  the  equation  f(z)  =  0  must  have  a  real 
root  greater  than  1.  But  the  three  roots  of  this  equation  are 


r,0r. 


If  all  of  these  are  less  than  1  the  two-factor  hypothesis  is  unten- 
able. Three  other  necessary  conditions  of  consistency  are  obtained 
by  permuting  the  subscript  1  in  turn  with  2,  3,  and  4.  Thus  for  con- 
sistency one  at  least  of  the  three  quantities  in  each  of  the  following 
four  sets  must  be  greater  than  or  equal  to  unity. 


r2i 

r3* 

^23 

rii  r\2 

^li   ^13 

^12  '« 

»14 

^13 

r34 

r12  r2i 

r12  r23 

^23  ^24 

r12 

»U 

^24 

r\Z  r23 

r\Z   ^34 

^23  ^34 

^12 

fl3 

^23 

r^r, 


[37] 


The  foregoing  are  necessary  but  not  sufficient  conditions.  If  these 
necessary  conditions  are  met,  one  should  then  investigate  the 
sufficient  conditions  in  Formula  35  to  finally  establish  the  ade- 
quacy of  two  general  factors. 

Let  us  here  present  a  problem  by  stating  a  proposition. 
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Proposition  14. — //  four  variables  taken  three  at  a  time  are 
such  that  any  three  may  be  thought  of  as  due  to  one  general  factor 
plus  specific  factors,  then  the  four  variables  may  always  be  thought 
of  as  due  to  two  general  factors  plus  specific  factors. 

The  writer  has  found  no  ready  means  of  either  proving  or  dis- 
proving this.  Though  considerable  theoretical  interest  attaches 
to  it,  we  do  not  need  it  for  our  further  treatment  and  will  there- 
fore leave  it  as  an  unsolved  problem. 

In  the  search  for  variables  requiring  more  than  one  general 
factor  we  can  start  with  three  variables.  If  variables  taken  three 
at  a  time  reveal  no  such  need  for  more  than  one  general  factor, 
then  we  will  investigate  variables  four  at  a  time  with  reference  to 
the  adequacy  of  one  general  factor  and  when  variables  four  at  a 
time  cannot  be  adequately  represented  by  one  general  factor  we 
will  investigate  variables  five  at  a  time  with  reference  to  the  suffi- 
ciency of  two  general  factors.  In  other  words  Proposition  12  sel- 
dom needs  to  be  an  instrument  in  the  investigation. 

There  are  occasionally,  however,  situations  in  which  its  use  is 
valuable.  If  four  variables  taken  three  at  a  time  reveal  two  sets  of 
three  which  cannot  be  thought  of  as  involving  one  general  factor, 
the  question  arises  as  to  whether  the  two  general  factors  demanded 
for  xls  x2,  xz  are  the  same  as  the  two  required  for  x1,  x2,  x4.  We 
may  illustrate  such  a  situation  as  this  by  the  data  of  Table  II.  The 

TABLE  II 
Table  of  Inter-Correlations 

Xl  X2  X3 

x» 050 

xz 220  .291 

xt 025  .069  —.087 

variables  have  been  chosen  because  from  evidence  at  hand  there  is 
known  to  be  much  independence  between  them.  The  data  are  for 
109  children  in  the  seventh  grade. 
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xx  —  Score  on  a  Speed  of  Reading  Test 

x2  =  Score  on  a  Power  in  Arithmetic  Reasoning  Test 

x3  —  Score  on  a  Manipulation  of  Spatial  Relationships  Test 

.\\  =  Score  on  an  Interest  in  Physical  Activity  Test 

Examining  variables  x\,  x2,  x3,  we  find  r13r23>r12.  Accordingly, 
Proposition  5  does  not  hold  for  these  three  variables.  Also 
r23  r24>r3i-  Thus  again  Proposition  5  does  not  hold.  For  vari- 
ables xlt  x2,  x4  Proposition  5  maintains.  Can  the  two  factors  re- 
quired for  variables  xv  x.,,  x3  also  be  thought  of  as  the  two  required 
for  x2,  x3,  x4?  We  will  first  investigate  the  necessary  conditions 
[37]. 


r2i 

>1 

ri4  ri2 

>'i4 

>1 

^12  ^*24 

r12 

^13  ^23 

r12 

>1 

84 


^14  ^13 
ri3 


<1  -^->1 


r*,u 


>1  -^-<1 

/    no      I    OA 


78<1     -^-<1  -^-<1 


<1  -1st-<1 


In  the  third  set  no  one  of  the  three  quotients  is  greater  than  unity, 
so  two  general  factors  plus  specific  factors  will  not  suffice  to  ex- 
plain these  four  variables.  Though  in  this  case  it  is  not  possible 
to  express  four  variables  as  due  to  two  general  factors  plus  four 
specific  factors,  generally  the  criteria  just  investigated  are  very 
easily  satisfied,  so  easily,  in  fact,  that  the  writer  has  not  made  a 
serious  search  for  four  variables  which  cannot  be  represented  as 
arising  from  two  general  factors  plus  four  specific  factors.  He 
has  extensively  studied  the  inter-correlations  between  five  vari- 
ables where  much  less  freedom  is  present.  The  probable  error  of 
the  four-variable  criterion  [35]  has  not  been  investigated,  but  as 
the  separate  functions  [37]  are  the  reciprocals  of  [15]  the  stand- 
ard error  of  one  of  these  functions  is  given  by  [16]  after  first 
replacing  /  by  1//. 
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Proposition  15. — Five  variables  may  be  thought  of  as  due  to 
two  general  factors  plus  five  specific  factors  when  the' following 
function,  which  will  be  referred  to  as  the  pentad  criterion,  because 
five  variables  are  involved,  equals  zero : 

/ 12345  =  ^12  ^13  ^24  ^35  ^45  "T"  ^14  ^15  ^23  ^24  ^35  l  r\%   **14  ^25  ^34  ^35 
I  ^13  ^15  ^24  ^25  **34  •  ^12  ^15  ^23  ^34  ^45  "T"  ^13  ^14  ^23  ^25  ^45 

'1  O  '1  4  '913  '  3*  '  A*       '1  3  'Ifi  '  9Q  '  9J  '   AK.  '  1  9  '  T  K    '")i  '  OA  ' 


12  '  14  '  23  '  35  '  45     '  13  '  15  '  23  '  24  '  45 
^13  ^14  ^24  **25  ^*35     *"l2  ^13  ^25  ^34  ^45 


12  '  15  '  24  '  34  '  35 
^14  ^15  ^23  ^25  ^34  ' 


[38] 


This  is  a  basic  criterion  in  the  study  of  differentiable  abilities. 
The  proof  of  it,  which  follows,  utilizes  the  same  notation  as  the 
proofs  of  the  earlier  propositions,  with  such  obvious  extensions  as 
are  required,  due  to  a  larger  number  of  variables,  and  with  such 
additions  as  will  be  noted.  Let 


then 


xx  =  cxa  +  kj)  +  e1 
x2  =  c2a  +  k2b  +  e2 
x3  =  c3a  +  k3b  +  c3 
x4  =  c4a  +  k4b  +  e4 
x5  =  c5a  +  k5b  +  e5 

r12  =  ax  a,  +  p\  f32 
r13  =  a,  a3  +  p\  |33 
rXi  =  ax  a4  +  (5,  |34 

»u  =  «i  «5  +  Pi  pB 

r23  =  a2  a3  +  P2  P3 
r24  =  a2  a4  +  (32  p4 
r25  =  a2  a5  +  (32 135 
^34  =  «3  a4  +  (33  p4 
r3B  =  a3  a5  +  |33  (35 
;-45  =  a4  a5  +  (34  |35 


[SV*  32] 


[S*e  34] 
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Let  Px/ck  =  h  ;  p2/a2  =  K ;  etc.  Then 

, [i] 


l  +  K  K 


"■1  "-2 


TTtA=a'a4 liH1 


r 


15 


1+1,  X 


=  o,a5 


\  +  KK       *  ' 


i  +  iX  =  a'a' 


i  +  hh=a>"' 


[iv] 


TfkK=a>a> W 

TTtjt=a*a< lVil 

=  a,as [vii] 


[viii] 


r**  [ix] 


=  o.aB M 


\+%h~    *   * 

From  Equations  i  and  viii,  from  ii  and  vi,  and  from  iii  and  v  we 
obtain 


(1  +  M2)  (1  +  XA)     (l+*i*.)(l  +  M«) 


**14  ^23 

~JT+kk)  0+M3) 

This  leads  to 

r,2r54  —  r14r2Z  r12r3i  —  r13r2i 

Kh  +  Kh-Kh-K^z    k ht  +  *»  k  - li h  - h h 
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which  may  be  written 


'    1  O    Ml  '    1 


(^-^M^-xj-^-xj  (x2-x3) 


Similarly 


mo    'on  '  1Q    M 


'  i  o   'q«  *  i 


M2  M5  M5  M4  M2  MS  M4  M5 


[xi] 


xii] 


Xlll 


Multiplying  [xi],  [xii],  and  [xiii]  we  obtain 

(.M2  M4  M4  r23J    VM2  M5  **13  M5)    V12  M5  M5M4/ 

=   (m2  M4  —  MS  M4)    (M2  MS  —  MB  Ms)    (M2  Mb  —  M4  Ms)  ■  ■  [39]  x 

Multiplying-  and  factoring,  Equation  39  may  be  written 

VM2  M3  Ms  +  M4  Ms  M3  /    V  24  Ms  Ms  M4  / 

"T"  V12  M4  Ms  ~T~  M3  Ms  r2i)    I  Ms  M4         M3  Ms/ 

+  (M2  MB  M4  +  M3  M4  Ms)    (ms  Ms  ~  Mi  Ms)  =  ° [40] 


It  can  also  be  written  as  the  sum  of  six  terms  minus  the  sum  of  six 
others  by  multiplying  out.  This  latter  way  has  seemed  the  most 
convenient,  and  to  abridge  the  notation  the  following  symbol  has 
been  used:  Jt:12:13:24:35:45  =  r12r13  r2i  r35  ri5  and  similarly  for 
jr's  with  the  other  following  numbers.  With  this  notation  [40] 
may  be  written 


/i2345=*  12 :  13  =24:35:45+ Jt  14:15:23:24 
+jt  13:15:24:25:34+*  12:15:23:34 
—X  12:14:23:35:45-Jt  13:15:23:24 
-rt  13:14:24:25:35-*  12:13:25:34 


35+at  12:14:25:34:35 

45+jr  13:14:23:25:45 
45— jc  12:15:24:34:35 
45-Jt  14:15:23:25:34 

[See  38] 


1 1  am  indebted  to  Dr.  C.  E.  Rhodes  for  assistance  in  the  solution  here 
given.  He  is  responsible  for  the  steps  represented  by  Equations  xi,  xii, 
xiii,  and  39. 
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Let  us  now  return  to  the  proposition  dealing  with  four  vari- 
ables. Suppose  we  have  four  variables,  xlf  x2,  .r3,  x4,  which  we 
wish  to  investigate  with  reference  to  the  adequacy  of  two  general 
factors.  Let  us  add  a  fifth  variable,  x5,  which  is  entirely  chance. 
Then  r15  =  r25  =  r35  =  r45  =  0.  Reference  to  [40]  shows  that  in 
this  case  the  pentad  function  equals  zero,  so  that  on  the  basis  of  this 
we  might  be  inclined  to  conclude  that  any  four  variables  plus  a 
fifth  which  was  chance  could  be  represented  by  two  general  factors 
plus  specific  factors.  If  this  conclusion  is  sound,  then  it  follows 
that  any  four  variables  could  always  be  represented  by  two  general 
factors  plus  specific  factors.  The  conclusion,  however,  is  not  sound, 
for  the  reason  that  we  are  not  concerned  with  the  absolute  value  of 
/i2345.  but  with  it  in  comparison  with  its  standard  or  probable  error. 
It  can  be  shown  that  in  general  if  xs  is  chance,  then 

J 12345     v 

ofMS    :=  0 

so  that  we  have  an  indeterminate  ratio.  Three  conclusions  may  be 
drawn  from  the  situation.  First,  we  must  not  conclude  that  every 
four  variables  can  be  thought  of  as  arising  from  two  general  fac- 
tors plus  specific  factors.  Second,  we  must  in  all  cases  draw  our 
conclusions  from  f123i5/Ofuus  and  not  from  /12345  alone.  Third,  if 
five  variables,  none  of  which  is  chance,  are  such  that  some  four  of 
them  meet  conditions  [26]  then  without  further  test  it  is  known 
that  the  five  variables  may  be  thought  of  as  arising  from  not  over 
two  general  factors  plus  specific  factors.  Accordingly,  we  will  only 
use  this  pentad  criterion  [40]  where  the  earlier  use  of  the  tetrad 
criterion  [26]  has  shown  that  no  four  selected  from  five  different 
variables  meet  criterion  [26]. 

A  knowledge  of  the  standard  error  of  /12345  is  essential,  and 
though  its  calculation  is  very  laborious  it  must  be  undertaken. 
Many  approximations  have  been  attempted,  but  none  is  believed 
trustworthy,  so  that  the  full  formula  for  the  standard  error  of  /12345 
is  recommended.  The  expression  of  this  formula  in  terms  of  N, 
the  population,  and  the  correlation  coefficients  is  unmanageable, 
and  so  far  as  the  writer  has  been  able  to  discover  gives  no  promise 
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of  greatly  simplifying,  so  that  a  formula  giving  0/12U5  in  the  primi- 
tive or  original  constants,  N,  r12J  r13,  r14,  r15,  r23,  r2i,  r25,  r3i,  r35,  r45, 
is  not  attempted.  The  numerical  solution  for  any  given  problem  is, 
however,  entirely  feasible.  Certain  new  symbols  are  used  in  the 
following  derivation.  Their  meanings  are  given  immediately  fol- 
lowing the  final  formula  obtained.  We  will  start  with  /12345  as 
given  in  [38]. 

A/  =  A12  C12  +  A13  C13  +  A14  C14  +  A15  C15  +  A23  C23 

+  A24  C24  +  A25  C25  +  A34  C34  +  A35  C35  +  A45  C45 [41] 

Squaring,  summing,  and  dividing  by  the  population  gives 

a*f  =  -[S(l  —  r\2)2  C\2  +  SC12  C13  ^12:13  +  SC12  C3ip12.3i]  [42] 

When  the  polynomial  giving  A/  is  squared  and  the  several  terms 
summed  and  divided  by  the  population,  three  types  of  terms  appear. 
There  are  ten  terms  of  the  sort  o2ri2  C212 


in  which 


°>12=  -^(l-r212); 


and  in  which 

r      _  (the  sum  of  all  terms  in  [38]  containing  r12)  r^-i 

and  C's  with  other  subscripts  have  similar  meanings.  The  term 
in  [42]  designated  S  (I — r2)2  C212  stands  for  the  sum  of  these 
ten  terms,  except  for  the  factor  1/N  which  is  taken  care  of  sepa- 
rately. 

There  are  60  terms,  but  only  30  different,  as  each  occurs 
twice,  of  the  sort  ori2  C12  ar,3  C13  rTl2  r13.  If  the  product-moment 
Gril  Or13  rril  ri3  is  represented  by  the  notation  />12:i3/jV,  these  60  terms, 
except  for  1/iV,  are  represented  in  [42]  by  SC12  C13p12:i3.  The 
quantity  pl2:i3  depends  upon  the  numerical  values  of  three  corre- 
lation coefficients  r12,  r13,  r23  and  may  be  evaluated  by  Formula  66. 
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There  are  30  terms,  but  only  15  different,  as  each  occurs  twice, 
of  the  sort  or,2C12or3i  Currnr3i  which  if  we  let  aru  Orurrilru= 
P\2-.zJN  may  be  represented,  except  for  1/iV  as  in  the  last  term  of 
[42J.  The  product-moment  in  this  term  depends  upon  the  inter- 
correlations  between  four  variables  which  are  no  less  than  six  in 
number,  so  that  it  is  scarcely  feasible  to  table  values  of  p  for 
different  values  of  these  six  correlation  coefficients.  The  following 
formula  has  been  found  convenient  for  the  calculation  of  p12:34'. 

Pi2:Si  =  Nor12orstrriir34 

=   ri3  '  24   "I      r\i  ^23  ^  12  riZ  ^14  ^12  ^23  ^24  ^13  ^23  **34 

-  rM  r24  r34  +  h\2  r3i  (r\3  +  r214  +  r-23  +  r22i) [44] 

It  is  thus  seen  that  the  variance  [42]  has  a  total  of  100  terms  each 
of  which  if  expanded  is  made  up  of  a  considerable  number  of 
terms.  As  at  best  it  takes  considerable  time  to  employ  this  formula, 
it  has  only  been  used  in  the  present  study  some  ten  or  a  dozen  times. 
It  does,  however,  enable  one  to  obtain  a  general  idea  as  to  the  size 
of  the  standard  error  of  the  pentad  functions  worked  with.  An 
illustration  showing  all  the  numerical  steps  in  the  computation  of 
Of  would  require  many  pages  and  is  not  here  given,  but  a  careful 
study  of  the  meanings  of  the  symbols  just  described  should  enable 
the  student  to  determine  such  a  standard  error  when  in  need  of  it. 
The  following  five-variable  problem  is  one  for  which  the  stand- 
ard error  of  the  pentad  function  has  been  calculated  : 

N  =  140  seventh-grade  pupils 

x1  =  .x\  of  Table  X  =  score  on  a  Speed  of  Reading  Test 

x2  =  x2  of  Table  X  =  score  on  a  Reading  Power  Test 

x3  =  xa  of  Table  X  =  score  on  a  Speed  of  Arithmetic  Computa- 
tion Test 

x4  =  x4  of  Table  X  =  score  on  an  Arithmetic  Reasoning  Test 

r5  =  x7  of  Table  X  =  score  on  a  Memory  for  Meaningful  Geo- 
metric Forms  Test 
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TABLE  III 
Table  of  Inter-Correlations 


*i 

x2 

X! 

** 

Xz i  . 

.6328 
.2412 
.0586 
.2969 

—.0553 
.0655 
.3322 

.4248 
.0215 

Xg 

X* 

_t"5 

2489 

We  shall  first  examine  these  variables  in  sets  of  four  to  ascertain 
if  any  four  may  be  represented  by  one  general  factor  plus  specific 
factors.   The  tetrad  differences  for  variables  x\,  x2,  .r3,  xi  are 

t12Si=  (.6328)  (.4248) -(.2412)  (.0655)  =  .25 

*1243=  (.6328)  (.4248) -(.0586)  (-.0553)  =27 

*1342=  (.2412)  (.0655) -(.0586)  (-.0553)  =  .02 

We  have  three  tetrad  differences  involving-  the  same  variables.  If 
one  were  to  choose  the  largest  of  the  three,  he  would  be  capitalizing 
any  chance  influence  that  contributed  to  the  making  of  this  differ- 
ence the  largest.  Similarly  one  should  not  choose  the  smallest  of 
these  three.  If  we  chose  the  mid-one  (in  absolute  value)  there  is 
no  systematic  chance  tendency  operating  one  way  or  the  other. 
We  will  thus  take  the  tetrad  difference  .25  as  most  representative 
of  the  tetrad  differences  of  these  four  variables. 

Following  the  same  procedure  for  all  other  combinations  of 
four  we  determine  the  data  of  Table  IV. 

Before  investigating  the  pentad  function  it  is  desirable  to  know 
if  any  of  these  tetrad  differences  deviate  from  0  by  an  amount  which 
may  readily  be  attributed  to  chance.  We  will  therefore  calculate 
the  standard  error  of  t1  B  4  3,  which  is  the  smallest  of  these  five 
tetrad  differences.  We  find  by  Formula  42  that  the  standard  error 
of  this  difference  is  .05.  Thus  the  difference  is  but  1.3  times  its 
standard  error.  Reference  to  a  table  of  the  normal  probability 
curve  would  indicate  that  the  chances  were  about  four  to  one  that 
the  difference  was  significant.  However,  since  the  tetrad  difference 
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chosen  for  investigation  was  so  chosen  because  it  was  the  smallest 
of  the  five,  this  statement  of  the  case  is  an  understatement.  The 
chances  are  surely  appreciably  greater  than  four  to  one  that  the 
difference  is  significant.  We  will  accordingly  consider  it  probable 
that  no  four  of  these  five  variables  can  be  thought  of  as  due  to  one 
general  factor. 

TABLE  IV 
Median  Tetrad  Differences 


Variables 

Median  Absolute  Value 

of  the  Three  Possible 

Tetrad  Differences 

Standard  Error  of 
Tetrad  Difference 

1234 

tl  2  3  4  =  25 

tl  2  3  5  =   .07 

£1254  =  .14 

U  5  3  4  =    .07 
h  5  4  3  =.14 

1235 

1245 

1345 

051 

2345 

Further,  since  conditions  [31]  are  so  readily  satisfied,  we  will 
not  trouble  to  apply  that  test  but  immediately  think  of  two  general 
factors  as  being  sufficient  for  each  set  of  four  variables.  Having 
determined  that  two  general  factors  are  needed  for  every  combi- 
nation of  the  five  variables  taken  four  at  a  time,  it  now  becomes 
of  interest  to  ascertain  if  the  same  two  can  be  thought  of  as  under- 
lying every  possible  set  of  these  five  variables  taken  four  at  a  time. 
The  determination  of  the  pentad  criterion  and  its  standard  error 
will  enable  us  to  answer  this  question.  The  value  of  the  pentad 
criterion  given  by  [38]  is  —.0056,  and  its  standard  error  given  by 
[42]  is  .0025.  Reference  to  a  normal  probability  table  shows  that 
the  chances  are  somewhat  less  than  3  in  100  that  a  pentad  func- 
tion as  large  as  this  would  arise  as  a  matter  of  chance.  We  there- 
fore must  conclude  that  not  only  is  a  single  general  factor  insuffi- 
cient to  account  for  these  five  variables  but  even  two  general 
factors  are  insufficient.  There  must  be  in  addition  to  specific  fac- 
tors no  less  than  three  basic  independent  traits  underlying  the  five 
variables. 
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When  we  have  four  variables  not  capable  of  representation  as 
coming  from  one  general  factor  plus  specific  factors,  it  may  be 
because  there  is  one  general  factor  running  through  three  of  the 
four  variables,  and  (a)  a  second  general  factor  running  through 
three  of  the  four  variables,  or  (b)  a  second  general  factor  running 
through  two  of  the  four  variables.  By  Proposition  13  we  need  not 
consider  the  situation  of  a  second  factor  running  through  all  four 
of  the  variables  as  by  an  appropriate  choice  of  the  first  general 
factor  this  can  be  reduced  to  a  situation  in  which  the  second  gen- 
eral factor  runs  through  three  only  of  the  four  variables. 

Thus  if  a  certain  tetrad  difference  involving  x\,  x2y  x3,  x\  does 
not  equal  0  we  have  the  two  following  situations  to  consider : 


First  situation 


Second  situation 


xx  =  cxa  -\-  e1 
x2  =  c2a  -\-  k2b  +  e2 
x3  =  c3a  +  k3b  +  e3 
xi  =  c4a  +  kjj  +  ei 

x1  =  cxa  +  e1 
x2  =  c2a  +  e2 
x3  =  c3a  +  k3b  +  c3 


[45] 


From  the  first  situation  we  have  Equations  33  and  34  already  given 
(page  54),  and  from  the  second  situation  we  obtain 


r12  =  ax  a2 

**13  =   ai  «3 

r14  =  aa  a4 

^23   ^   ^2  ^3 

r2i  =  a2  a4 

^34  =  a3  a4  +  p3  P4 


[46] 
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In  this  case 

'i  2  3  *  =  r12  rg4  —  r18  r24  =  ttl  a,  (33  (34  ^  0 
*i  2  4  3  =  'i2  r34  -  rM  r23  =  a,  a,  |33  (34  ^  0 


*13  4 


*  t  a   ' oi  '  i a    '  n 


=  0 


[47] 


The  characteristic  of  this  second  situation  is  that  of  the  three  tet- 
rads two  are  equal  and  one  equals  0.  It  is  not  necessary  to  state  that 
one  of  these  is  equal  to  0,  for  if  two  of  the  tetrads  are  equal,  the 
third  is  of  necessity  equal  to  0.  It  so  happens  that  many  experi- 
mental situations  give  two  nearly  equal  tetrads  which  are  not  equal 
to  0.  As  an  illustration  we  may  note  the  following  tetrads  derived 
from  Table  X  of  chapter  iv : 

TABLE  V 
Certain  Tetrads  for  Seventh-Grade  Population  of  140 


Tour 
Variables 

Three  Tetrads 

Designation 

of  Smallest 

Tetrad 

Variables 

Having  Second 

Factor 

Largest 

Smallest 

1234 

1245 

124  6 

1247 

1248 

124  9 

1256 

1257 

1258 

1259 

1267 

1268 

1269 

1278 

1279 

1289 

1348 

1349 

135  6 

1357 

1358 

1359 

27 
08 
17 
14 
17 
22 
40 
36 
25 
22 
32 
26 
22 
37 
28 
30 
08 
09 
16 
16 
06 
10 

25 
08 
17 
14 
17 
22 
38 
33 
23 
22 
31 
26 
21 
36 
26 
29 
07 
08 
13 
15 
06 
10 

02 
01 
00 
00 
00 
00 
01 
03 
01 
01 
01 
00 
01 
01 
02 
01 
02 
01 
03 
01 
00 
00 

113  4  2 

114  5  2 
114  6  2 
114  7  2 
t\  4  8  2 
114  9  2 
t\  6  6  2 
1 1  7  5  2 
fl   8  .">  2 
119  5  2 

fl  8  0  2 

116  9  2 

117  8  2 
(17  9  2 
/l  S  9  2 

118  3  4 
(13  9  4 
fl   I  I  3 
117   5  3 
(15  8  3 

12     or     34 
12            45 
12            46 
12            47 
12            48 
12            49 
12            56 
12            57 
12            58 
12            59 
12            67 
12            68 
12           69 
12            78 
12            79 

12  89 
14            38 
14           39 

13  56 
13            57 
13            58 
13            59 
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TABLE  V — Continued 
Certain  Tetrads  for  Seventh-Grade  Population  of  140 


Four 
Variables 


1378 
13  79 
1389 
1479 
2345 
2346 
2347 
2348 
2349 
2458 
2459 
2569 
2578 
3456 
3457 
345  8 
3  459 
3467 
3468 
3478 
3479 
3489 
3567 
3568 
3569 
3678 
3679 
3689 
4567 
4578 
4579 
4789 
5678 
5679 
5689 


Three  Tetrads 


Largest 


16 
13 
13 
08 
14 
14 
15 
12 
14 
06 
09 
07 
06 
29 
28 
19 
18 
26 
20 
29 
22 
22 
14 
08 
08 
15 
11 
11 
10 
09 
17 
12 
20 
11 
19 


15 
12 
12 
06 
13 
11 
14 
10 
12 
06 
08 
06 
05 
27 
27 
19 
17 
21 
15 
28 
22 
21 
13 
06 
08 
12 
11 
10 
08 
07 
14 
10 
16 
10 
17 


Smallest 


01 
00 
01 
02 
01 
03 
02 
02 
02 
01 
01 
00 
01 
02 
01 
00 
01 
05 
05 
01 
00 
01 
01 
02 
00 
03 
01 
01 
02 
01 
03 
02 
04 
02 
02 


Designation 

of  Smallest 

Tetrad 


9  4  7 

4  8  5 

4  3  6 

4  3  7 

4  3  8 

4  3  9 

8  4  5 

9  4  5 

5  6  9 
8  7  5 

6  6  4 
5  7  4 
5  8  4 

5  9  4 

6  7  4 

6  8  4 
8  7  4 

7  9  4 

8  9  4 
5  7  6 
8  5  6 

5  9  6 

8  7  6 

9  7  6 
8  9  6 

6  7  5 

7  5  8 

7  5  9 

8  7  9 
7  8  0 

7  9  6 

8  9  6 


Variables 

Having  Second 

Factor 


13 
13 
13 

17 
25 
26 
27 
28 
29 
25 
25 
29 
25 
34 
34 
34 
34 
34 
34 
34 
34 
34 
36 
36 
36 
36 
36 
36 
45 
48 
49 
49 
56 
56 
56 


78 
79 
89 
49 
34 
34 
34 
34 
34 
48 
49 
56 
78 
56 
57 
58 
59 
67 
68 
78 
79 
89 
57 
58 
59 
78 
79 
89 
67 
57 
57 
78 
78 
79 
89 


The  cases  involving  variables  x3,  x4,  xe,  x7 ;  xs,  x4,  x6,  x8 ;  and 
xt,  x0,  x7,  x8  may  be  doubtful,  but  omitting  these  the  number  and 
striking  character  of  the  remaining  sets  of  tetrads  rules  out  the 
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possibility  of  chance  being  the  cause.    The  probable  error  of  the 
tetrad  differences  here  given  is  in  the  neighborhood  of  .035. 

The  conditions  obtaining  between  the  six  correlation  coefficients 
when  two  of  four  variables,  x1  and  x2,  are  dependent  upon  one  gen- 
eral factor  a,  and  the  other  two,  x3  and  x4,  upon  two  general  factors, 
a  and  b,  are  identical  with  that  obtaining  if  x3  and  x4  are  dependent 
upon  one  general  factor  only  and  x1  and  x2  are  dependent  upon  two 
general  factors.  Thus  if  tx  3  4  2  =  0  (note  that  this  is  the  tetrad  not 
containing  r12  or  r34),  we  may  conclude  that  xx  and  x2  possess 
some  second  factor  b,  or  that  x3  and  x4  possess  such  a  second  factor, 
or  that  xx  and  x2  possess  a  second  factor  b,  and  xa  and  x4  a  third 
factor  c.  We  do  not  know  which  of  these  three  situations  correctly 
describes  the  facts  and  further  we  never  can  tell  merely  from  a 
knowledge  of  the  six  inter-correlations,  as  will  now  be  proved.  Let 
us  first  note,  however,  that  the  third  alternative  will  generally  not 
concern  us,  as  we  will  systematically  choose  the  hypothesis  involv- 
ing the  lesser  number  of  unknown  factors. 

Proposition  16. — //  the  inter-correlations  between  four  vari- 


ables are  such  that  tx 


*i  2  4  3  and  h 


0,  they  could  con- 


ceivably have  arisen  from  four  variables  xXi  x2,  x3,  x4  through 
which  zvas  a  general  factor  plus,  in  addition  thereto,  a  second  factor 
common  to  xt  and  x2  or  a  second  factor  common  to  x3  and  x4. 


If,  given  the  system,  xx  =  cxa  -\-ex 

xz  =  cza  +  kzb  +  ez 
x\  —  cia  +  k4b  +  e4 


[5V?45] 


it  is  required  to  prove  that  the  following  is  a  synonymous  system 
xx  =  Cxc  +  Kxd  +  ex  " 
x2  =  C2c  +  K2d  +  e2 
ji3  =  L  3c  -f-  e3 
x4  =  C4c  -f  e4 


[48] 


[49] 


If  [48]  holds,  then 
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If  the  system  [45]  holds,  then 
r12  =  ax  a2 

^13  =  «1  «3 

r14  =  ax  a4 

^*23  ==  **2  **3 

r24  =  a2  a4 

^34  =  a3  a4  +  ps  |34 

^12  =  Yi  Y2  +  Si  S2 
^13  =Yi  Ys 

ru  =  Yi  Y4 
^23  =  Y2  Ys 

^24  =  Y2  Y4 

''34  =  Ys  Y4 

in  which  the  y's  and  the  8's  are  defined  in  a  manner  similar  to 
that  for  the  a's  and  (3's.  If  the  following  substitutions  (discovered 
by  the  writer  after  a  mathematical  development  which  was  un- 
doubtedly needlessly  indirect  and  therefore  not  here  repeated)  for 
the  factors  in  system  [49]  are  made, 

ai  =  Yi 9 

a2  =  Y2  9 

a3  =  Ys  9 

a4  =  Y4  9 

Yi  Y2  +  &i  82 


[50] 


0  - 


YlY2 

St  S2  Ys  Yj 
Yi  Y2  +  &i  82 
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then  the  system  [49]  will  be  found  to  transform  into  system  [50] 
thus  proving  the  proposition. 

It  is  thus  futile  to  look  to  the  six  inter-correlations  for  evidence 
as  to  whether  x1  and  x2,  or  xz  and  x4  possess  the  second  general 
factor. 

We  may  obtain  a  suggestion  upon  this  point  by  study  of  the 
coefficients  of  correlation  corrected  for  attenuation  between  xx 
and  x2  and  between  xz  and  x4.  If  system  [49]  holds  and  if  x^,  xw, 
xx,  xv  stand  for  the  true  scores  in  xlt  x2,  xs,  xit  respectively,  then 
it  is  probable  that  r00£0>rTU,  while  if  the  system  [50]  holds,  in  all 
probability  rTU>rcoa,,  while  if  they  are  about  equal  and  each  high 
the  inter-correlations  may  readily  have  arisen  from  system  [51] 
following,  in  which  a,  b,  c,  and  the  tf's  are  independent. 

x1  =  ct  a  +  ]\c  +  ex 

x2  =  c2a  +  j2c  +  e2 
xz  =  c3  a  +  kz  b  +  es 
xi  =  cAa-\-  kib  -\-  c^ 


[51] 


This  system  may,  by  appropriate  substitutions,  be  transformed 
into  either  [45]  or  [48].  It  leads  to  the  same  objective  situation, 
namely,  ^234  =  *i  243^0  and  ^342  =  0  as  do  systems  [45] 
and  [48].  Adopting  the  law  of  parsimony  we  will  not  resort  to 
this  system  [51]  if  systems  [49]  and  [50]  suffice. 

When  the  situation  t1 234  =  ^  2  4  3  ^  0  arises  we  may  utilize 
other  variables  and  calculate  tetrad  differences  involving  xl,  x2,  .r,, 
and  Xj,  and  again  involving  x3,  x.l}  xi;  and  x,,  with  the  expecta- 
tion that  if  the  special  factor  b  is  found  in  xx  and  x2  and  not  in  x3 
and  x4  the  tetrad  difference  tx  2  %  j  =  t1 2  j  i  ^  0  whereas  f8  4  *  i 
=  t3  4  j  i  =  0.  If  this  is  done  for  all  combinations  of  the  variables 
four  at  a  time,  in  which  a  second  factor  b  has  been  found  to  run 
through  two  only  of  four  variables  we  may  obtain  information  as 
to  which  variables  have  special  bonds  as  illustrated  in  Table  \  1. 
In  this  table  the  two  numbers  in  the  captions  of  the  columns  indi- 
cate two  of  the  variables  involved  in  a  tetrad  difference  as  gfiven 
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in  Table  V.  The  entries  in  the  columns  give,  to  the  first  two  decimal 
places,  the  median  absolute  value  of  the  three  tetrad  differences 
arising  from  a  certain  four  variables.  For  example  in  Table  V  the 
median  tetrad  difference  for  variables  xlf  x2,  x3,  x±  is  .25,  and  since 
the  smallest  tetrad  difference  is  tiz  i2  this  indicates  a  special  bond 
between  xx  and  x2  or  between  x3  and  x±.  Accordingly  the  .25  is 
written  in  Table  VI  once  in  column  12  and  a  second  time  in  column 
34.  The  same  manner  of  entry  has  been  followed  for  all  the  other 
median  tetrad  differences  of  Table  VI. 

The  larger  the  sums  of  the  columns  the  greater  the  indication 
of  a  special  bond  between  the  variables  indicated  in  the  captions. 
This  table  will  aid  us  in  the  future  study  of  special  factors. 

If  from  a  study  of  the  four  variables  x±,  x2,  x3,  .r4  we  conclude 
that  a  special  bond  exists  between  either  x1  and  x2  or  between  x3 
and  x4  we  may  secure  presumptive  evidence  as  to  which  of  these 
is  the  case  if  a  single  additional  variable  is  available,  x5,  by  sub- 
stituting it  in  turn  for  x1,  x2,  x3,  x4.   If  the  bond  is  between  x1  and 

TABLE  VI 

Median  Tetrad  Differences  Allocated  to  the  Pairs  of  Variables 
From  Which  They  May  Have  Arisen 

12     13     14     15     16     17     18     19     23     24     25     26 

25    13    7  6  13    11 

8    15    8  6 

17    6  8 

14    10  5 

17    15 
22    12 
38    12 
33 
23 
22 
31 

2<; 

21 
36 
26 
29 

388   83   15  6  32   U 
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TABLE  VI— Continued 


27 


28 


39 


45 


47 


14 


10 


2   25 

13 

6    13 

6 

11 

8 

14 

12 

10 

11 

12 

10 

27 

27 

19 

17 

21 

15 

28 

22 

21 

17 


II 


14 

10 

18 

282 

60 

7 

8 

16 

17 

14 

48 

49 

56 

57 

58 

59 

67 

68 

69 

78 

79 

89 

17 

22 

38 

33 

23 

22 

31 

26 

21 

36 

26 

29 

6 

6 

13 

15 

6 

10 

21 

15 

15 

12 

12 

7 

8 

6 

27 

19 

17 

8 

5 

22 

21 

14 

27 

13 

6 

8 

28 

11 

10 

10 

16 
10 
17 

7 
14 

12 
10 
16 

10 

17 

30 

60 

127 

109 

54 

57 

60 

41 

21 

122 

81 

89 

.r2,  system  [52]  below  holds,  and  if  between  xz  and  xt,  system  [53 
holds. 

If  the  b  factor  lies  in  .x\  and  x2  then 

^1  2  3  4  ~   'l  2  4  S  ^  " 

^0 


1235   '12  5  3 

=    '1254^0 


1245 
15  3  4 
■J  5  8    t 


/, 


=  0 
=  0 


[52] 
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If  the  b  factor  lies  in  x3  and  xi  then 

n  2  3  4  =  T  2  43  ^  ^ 
'l  2  3  5  =  *12  53  =  ^ 
^1  2  4  5  =  'l  2  5  4  =  " 

0 

^2  5  4  3  ^  U 


[53] 


It  was  stated  that  the  evidence  was  presumptive  only.  The  reason 
for  this  qualification  lies  in  the  fact  that  when  x5  is  substituted 
for  x±  it  is  not  necessarily  true  that  the  a  factor  running-  through 
the  four  variables  xlt  x2,  xs,  x4  is  the  same  as  the  a  factor  running 
through  xlf  x2,  x3>  x5.  If,  however,  when  not  only  x5  is  substi- 
tuted, but  also  when  .rc,  x7,  etc.,  are  substituted,  systems  such  as 
[52]  and  [53]  always  indicate  that  xt  and  x2  possess  a  special 
bond  and  not  x3  and  x\,  the  evidence  is  practically  conclusive  that 
the  special  bond  lies  in  xx  and  x2  and  not  in  x3  and  x±.  We  may 
illustrate  this  by  a  study  of  variables  xlf  x2,  x6,  .r9.  Variables  xa 
and  x9  have  here  been  chosen  because  the  data  of  Table  VI  sug- 
gest that  these  latter  are  not  possessed  of  a  special  bond.  We  have 


'1269   -^1 


*i 


.22 


h 


.01 


This  indicates  a  special  bond  between  xx  and  x2  or  between  ,r6  and 
xB.  We  will  first  use  x3  for  the  fifth  variable.   We  then  have 


*1  2  3  6  =  ■"» 
»1  2  3  9  =  —.Us) 
'l  3  0  9  =       •1U 

'23  6  9   ==  — -UO 


*1  2  6  3  =       -16 

n  2  9  3  ==     •U«5 

'13  9  6  ==       •'JO 
*2  3  9  6  =  --09 


^169  2=    .08  (a) 

*1898=    .08  (&) 

<1693-  --04  (C) 

^2  639   =  -.06  (rf) 


The  row  (a)  throws  no  light  upon  the  issue.     It  rather  suggests 
that  some  special  bond  exists  between  x3  and  one  of  the  variables 
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xx,  x2,  and  x9.  The  same  inconclusive  evidence  is  present  in  rows 
(b),  (c),  and  (d),  for  the  probable  error  of  these  tetrad  differences 
is  in  the  neighborhood  of  .035.  We  will  repeat  the  process  using 
x4  in  place  of  x3.  We  have 

*12  46  =   -17      f1264=   -17       ^1462=   -00    (d) 

t12i9=    .22    *1294=  .22    tli92  =    .00  (6) 

^14  6  9  =  -06     f1496  =  -03     *169  2  =   -03   (c) 
^2  4  6  9  =  -.08      ^2496  =  —  -00       ^2  6  9  4  =   -03    (d) 


Rows  (a)  and  (b)  very  clearly  indicate  that  the  special  bond 
exists  between  xx  and  x2,  while  rows  (c)  and  (a7)  give  tetrads 
deviating  from  0  by  amounts  quite  readily  attributable  to  chance 
and  thus  scarcely  indicate  a  bond  between  .r6  and  x0.  Let  us,  how- 
ever, continue  further  using  x5  as  our  fifth  variable.  The  tetrads 
are 


^12  6  6  — 

.40 

'  1  2  6  5  = 

.38 

'i  5  e  2  =  -.01 

(a) 

'l  2  5  9  — 

.22 

1 1  2  9  5  — 

.22 

t1 ,  9  2  =  -.01 

(*) 

'15  6  9  —  ' 

-.02 

*1  5  9  6  =  ' 

-.06 

*1  6  9  5  =  —-04 

(O 

'2  5  6  9  = 

.00 

*2  6  9  6  = 

-.06 

*2  6  9  5  =  -.07 

(d) 

Here  again  the  evidence  is  very  strong  that  the  special  bond  is 
between  xx  and  x2  and  not  between  x6  and  xa.  Continuing  similarly 
with  x7 


'l  2  6  7   = 

.32 

'12  7  6   -31 

*1  6  T  2  =~  -01 

(«0 

>1  2  7  9  = 

.26 

^12  9  7=       -28 

flT92  =      -02 

(&) 

'17  6  9  = 

.00 

H  7  9  6  =       -01 

fie9T=    .00 

(O 

*2  7  6  9  =  ' 

-.02 

'2  7  9  6  =   — .U«J 

*2  6  9  7  =  —.01 

(<*) 
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Again  the  special  bond  is  indicated  as  lying  between  x\  and  x2  and 
not  between  x6  and  xg.  Finally  we  will  use  x8  as  the  odd  variable 

*i  2  6  s  =    -25        ^286=    .26        ^i  c  8  2  =    -00     (a) 

*1  2  8  9  ==       •^  '12  9  8—       •«jU  »1  8  9  2  =       •Ul  (  #  ) 

*1  8  6  9  ==  — -U4  'l  8  9  6  =  — .Ul  h  6  9  8  =       "Oo         (  C  ) 

*2  8  6  9  =  — .Uj  £  2  8  9  6  ==  —.Uo  *2  6  9  8   =       A"*         (<*) 

Here  again  the  special  bond  is  indicated  as  lying  between  xx  and  x2. 

This  concludes  the  number  of  such  tests  of  the  question.  We 
are  clearly  justified  in  saying  that  a  special  bond  exists  between 
xx  and  x2.  If  we  study  Tests  1  and  2  we  are  warranted  in  conclud- 
ing that  this  bond  is  of  the  nature  of  "facility  with  verbal  material." 
Further,  since  no  special  bond  between  x6  and  x9  has  as  yet  been 
indicated  these  particular  variables  will  prove  valuable  to  use  in  the 
search  for  other  special  bonds. 

Finally  if  it  is  true  that  there  is  no  special  bond  between  .r6  and 
x0,  and  if  the  special  b  factor  in  x1  and  x2  is  the  only  special  b 
factor  entering  into  either  of  these  variables,  then  every  pentad 
function  p1269j  where  x,  may  be  x3,  x±,  x5,  x7,  or  x8  will  equal  0. 
The  various  pentads  are : 


(It  is  known  to  be  small  because  one 
set  of  three  tetrads  involving  four  of 
these  five  variables  yields  three  small 
values.) 


/>12369   =  -0034 

/>i2469  =  small 

^12569   =    -0006 

/>i2679  =  small 
P12689  =  small 

The  pentad  function  px23a<>  is  probably  about  one  and  one-half 
times  its  standard  error,  so  it  is  likely  there  is  a  small  added  special 
factor  between  x1  and  x3  or  between  x2  and  x3.  Reference  to 
Table  VI  indicates  that  it  is  likely  that  this  small  bond  is  between 
xx  and  xa  and  not  between  x2  and  x3.  If  this  is  the  case  the  bond  is 
presumably  of  the  nature  of  "speed." 
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This  chapter  is  concerned  with  the  presentation  of  methods 
rather  than  the  detailed  investigation  of  the  data,  so  we  will  not 
here  repeat  steps,  such  as  those  just  concluded,  in  order  to  find  if 
there  exists  a  special  bond  between  x\  and  x3. 

Let  us,  however,  attempt  to  ascertain  the  relative  sizes  of  the 
general  factor  a  and  of  the  special  factor  b  involved  in  .\\  and  x2. 
We  have  established  that  for  .x\,  xz,  xc>,  x,,  we  may  with  high  prob- 
ability write  down 

.i-i  =  da  +  kxb  +  ex 

x.,  =  c2a  -f-  k.Jb  +  c2 

.r6  =  c6a  +  eR 

.r9  =  c9a  +  e9 


giving 


r12  =  ax  a,  +  p\  p\ 
r16  =  ax  a6 
r19  =  ax  a9 


(i)  r26  =  a2a6       (iv) 

(ii)         r29  =  a2a9        (v) 
(iii)       r69  =  a6a9        (vi) 


From  (ii)  and  (iii)  we  obtain 

a6  _  ria  _  .2318 
~^~9~  ~d~o  ".I960 

From  (iv)  and  (v)  we  obtain 


1.18 


a6  _  r2C>      .2988 
a9       r29       .2770 

From  (vi)  we  have 

;-,,9  =  a6a9  =  (1.13a9)  (a9 ) 

yielding 

r69  4351 


a-9  = 


1.13  ""   1.13 


=  .385 


average  =1.13 
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±.62  and  a,,  =  ±70 


Since  a6  and  a9  must  have  the  same  sign  because  r69  is  greater  than 
0  and  since  it  does  not  matter  which  sign  we  attach  to  these  a's 
we  will  choose  the  positive  sign.   From  (v) 


From  (iv) 

From  (iii) 
From  (ii) 

From  (i) 


a2  = 


r29 

.1/  /  U 

a9 

.62 

r2e 

.2988 

70 


.1960 


a,  = 


.62 


.2318 


a6      70 


=  .447 


=  .427 


=  .316 


=  .331 


.  averasre 


.437 


average  =  .324 


Pi  (32  =  r12  —  d  a2  =  .6328  -  .1415  =  .4913 


Thus  if  we  assume  temporarily  that  p\  =  (32,  each  is  equal  to 
V-4913,  or  70.  It  is  noteworthy  that  the  special  b  factor  in  these 
two  tests  is  much  larger  than  the  general  a  factor.  It  should  again 
be  emphasized  that  this  calculation  leads  merely  to  presumptive 
values  of  a15  a2,  aG,  a0,  p\,  (32,  though  considerable  support  to  the 
procedure  is  given  by  the  fact  that  the  three-times  averages  have 
been  taken  (yielding  1.13,  .437,  and  .324)  and  the  values  averaged 
have  differed  by  such  small  amounts  that  the  differences  could  well 
be  attributed  to  chance. 

Having  ascertained  that  a  special  factor  exists  between  xt  and 
x2  we  may  investigate  the  remaining  variables  for  other  b  factors. 
Table  VI  immediately  suggests  that  x.6  and  xA  should  be  studied. 
The  tetrad  differences  which  could  be  influenced  by  the  x1  x2  bond 
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will  be  omitted  from  such  a  study.  A  study  of  this  nature  does 
indicate  an  .r3  xi  bond.  If  x\,  x2,  xz,  xt  may  be  represented  by  such 
a  system  as  [51],  page  71,  there  is  no  point  in  investigating  these 
four  variables  by  [35],  for  as  already  pointed  out  it  would  be 
known  that  they  could  be  expressed  as  indicated  in  system  [45]  or 
system  [48],  page  69.  It  would  be  profitable  to  express  xv  x2,  xs, 
xt  as  simply  due  to  an  a  and  a  b  bond,  were  such  an  explanation  also 
serviceable  in  other  connections.  To  determine  if  this  is  the  case, 
we  must  add  a  fifth  variable,  Xj,  determine  the  pentad  function 
Pi23ij,  and  ascertain  if  in  general  two  bonds  are  sufficient.  Table  X 
yields  the  following  pentad  functions. 

/>i2345  =  -.0028 

p123iG=    .0004 

^12347  =  -.0056 

/>i234S  =  -.0003 

/>12349   =  --0073 

4siL=    -0025 

Presumably  two  of  these  pentads  are  less  than  their  probable  errors 
(though  of  this  we  cannot  be  absolutely  certain  without  calculation, 
for  cPl234.  alone  has  been  calculated),  while  the  other  three  are 
apparently  considerably  larger  than  their  probable  errors.  On  the 
whole  the  results  indicate  that  when  xlf  x2,  x3,  x4  are  combined 
with  other  variables  the  total  situation  demands  for  its  explanation 
not  less  than  three  general  factors. 

The  type  of  analysis  thus  far  illustrated  in  this  chapter  may  be 
pursued  farther  to  secure  suggestions  of  still  additional  bonds. 
It  does,  however,  fail  as  a  desired  technique  when  the  number  of 
factors  exceeds  three,  and  it  even  is  insufficient  for  two  or  three 
factors  in  that  it  does  not  tell  just  where  the  various  factors  are 
located  and  what  are  the  numerical  values  of  their  standard  devi- 
ations. On  these  accounts  another  method  has  been  developed.  It 
will  be  illustrated  by  an  example  using  the  basic  data  for  the  popu- 
lation of  140  seventh-grade  children  given  in  the  next  chapter. 
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The  steps  may  be  outlined  as  follows:  (a)  Determine  tenta- 
tive standard  deviation  values  for  the  various  factors  in  «ach  vari- 
able. This  may  be  done  as  in  chapters  iv,  v,  etc.,  by  finding  the 
mean  value  of  all  the  tetrads  involving  xx  x2,  again  of  those  in- 
volving xx  x3,  etc.,  and  tentatively  assigning  factor  values  so  that 
the  bonds,  other  than  that  given  by  a  general  factor,  running 
throughout  all  the  variables,  are  largest  for  those  pairs  of  variables 
giving  the  largest  mean  tetrads.  Further,  this  may  be  done  by 
utilizing  the  propositions  already  given  covering  three,  four,  and 
five  variables,  (b)  Refine  these  preliminary  values  so  as  to  reduce 
the  mean  square  error  of  estimate  of  the  inter-correlation  co- 
efficients. 

We  will  start  with  the  preliminary  factor  values  as  given  in 
Table  XI,  chapter  iv,  and  here  describe  the  steps  involved  in  their 
refinement. 

The  calculation  employs  the  method  of  least  squares  and  re- 
quires for  its  serviceability  that  corrections  to  these  preliminary 
factor  values  be  small  with  reference  to  the  values  themselves,  for 
the  second  and  higher  power  terms  are  neglected  in  comparison 
with  first  power  terms.  Further,  since  there  are  only  slightly  over 
thirty-six  equations  of  condition,  represented  by  the  thirty-six 
inter-correlations  and  such  reliability  coefficients  as  can  be  em- 
ployed, it  is  obvious  that  the  number  of  factor  values  assigned 
should  be  less  than  this  for  the  least  square  determination  must 
have  fewer  independent  variables  than  equations  of  condition.  The 
cells  starred  in  Table  XI  total  twenty-six  and  adding  those  double 
starred  (as  explained  shortly)  we  have  a  total  of  thirty-one,  so  that 
we  are  quite  clearly  approaching  the  upper  limit  of  the  number  of 
independent  factors  which  it  is  worth  investigating.  The  problem 
now  is  how  closely  will  twenty-six  (or  thirty-one)  independent 
factors  located  in  the  cells  noted  describe  the  complex  situation 
represented  by  the  inter-correlations  and  reliability  coefficients 
which  have  been  found.  The  solution  obtained  after  a  number  of 
successive  approximations  yields  the  values  given  in  Table  XII. 
We  will  now  explain  the  method  of  reaching  this  least  square  solu- 
tion.  The  preliminary  estimate  of  the  size  of  ax  is  .3.    Let  us  for 
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the  moment  assume  that  all  the  other  factors  are  correctly  estimated 
and  that  this  one  is  wrong,  and  that  it  should  be  (.3  -f-  a)  in  which 
a2  is  negligible  in  comparison  with  a.  Then  we  have 

rl7  =  (.3  +  a)2+  (.7)2  +  (.2)2  +  (o\) 

from  which 

2(.3)a  =  (rl7  -  o-Ei)  -  .09  -  .49  -  .04 

Assuming  as  explained  in  chapter  iv,  page  102,  that  a2El  is  at  least 
equal  to  .05rl7  we  have 

2(.3)a<  (.95^,-. 62) 

<[.95  (.92)  -.62] 

<.25 

As  long  as  a  is  such  a  value  that 

2(.3)o<  .25 

we  will  neglect  this  condition,  but  if  2 (.3) a  >  .25  then  the  first 
of  our  condition  equations  will  be  2(.3)a=  .25.  In  other  words 
the  difference  from  zero  of  the  following  expression 

[.25-2(.3)a] 


is  the  residual  or  error  of  estimate.  For  the  second  condition 
equation  we  have 

r„=(.3  +  a)  (.4)  +(.7)  (.7) 

yielding,  since  r12  =  .63 

[.02-(.4)a] 

as  the  residual  or  error  of  estimate.  A  similar  condition  equation 
may  be  written  for  every  other  correlation  coefficient  involving  xlt 
giving  eight  condition  equations  coming  from  inter-correlation  co- 
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efficients  and  one  which  is  occasionally  of  service  coming  from  a 
reliability  coefficient. 

We  now  wish  to  so  determine  a  that  the  sum  of  the  squares  of 
the  errors  of  estimate  shall  be  a  minimum.  This  is  readily  done  if 
we  will  first  express  the  condition  equations  in  symbolic  terms. 
Let  ax  be  the  preliminary  estimate  of  the  general  factor  in  x1 ;  a2 
of  the  general  factor  in  x2 ;  .  .  .  .  a9  of  the  general  factor  in  xg ; 
f}2  of  the  second  factor  in  x2 ;  etc. ;  and  let  e12  be  the  residual  error 
in  the  condition  equation  involving  r12 ;  elz  the  error  in  the  condi- 
tion equation  involving  rls ;  etc. ;  eu  the  error  in  the  condition 
equation  involving  rxi  (when  ru  is  used).  Then  the  eight  (or 
nine)  condition  equations  are 

*i2  =  *ia  —  cti  a2  —  Pi  p2  —  Yi  Y2 

—  Oi  O2  —  £1  ^2  —  ?1  S2 

—  a2ax 

which,  if  we  let  q12  stand  for  the  residual  in  the  case  of  the  prelimi- 
nary estimation,  we  may  write 


Similarly 


0i2  =  Q12  —  a2  d 
013  =  Q13  —  «3  Ol 


019  =  Q19  —  a9  ax 
0i/  =  Qu  —  2a1a1. 


[54] 


[55] 


Let  us  square  these  residuals  and  sum,  in  order  to  determine  the 
value  of  a  yielding  the  least-square  error.  We  will  consider  two 
cases,  first  when  [55]  is  not  involved,  and  second  when  it  is.  For 
the  first  case  we  have 


2  e2ip=  2(pip  —  apa^'- 


[56] 
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in  which  the  subscript  p  takes  all  values  from  one  to  nine  except  the 
value  1.  Differentiating  this  function  with  respect  to  ax  and  setting 
the  derivative  equal  to  0  will  give  us  the  required  value  of  ax. 

da  1P-  =  2  2(q1p  — apaO  (— ap)  =  -2(2apQip  —  a^a^)  =0 
from  which 


a,  = 


2aP  QiP 

2a2, 


If  we  let  2a2  equal  2  of  all  the  a2  values,  including  a2x,  this  equa- 
tion may  be  written  in  the  following  form  which  is  more  simple 
to  use 

2ap  Qlp  (to  be  used  when  ru   j  r^71 

(2a2)  —  a2x     is  not  involved)  "*•      * 

For  the  second  case  we  readily  obtain 

(2ap  Qip)  -f-  2qxi  ax    (to  be  used  when  ru   1  rro-i 

(2a2)  +  3a2x         is  involved)  '  '  *■      ■* 

Equation  57  or  58  gives  the  correction  in  the  preliminary  esti- 
mate which  is  required,  provided  the  values  of  all  other  factors  are 
correct. 

Of  course,  the  values  of  these  other  factors  are  not  correct,  so 
the  best  way  to  proceed  is  to  calculate  alt  a2,  .  .  .  a9,  blf  b2,  .  .  .  fcft, 
•  ■  ■  fi,  f2>  ■  ■  •  /s»  using  throughout  the  preliminary  weights  and 
correct  for  the  one  of  these  which  is  found  to  be  the  largest.  Hav- 
ing done  this,  recalculate  and  correct  for  the  one  which  is  then 
the  largest,  and  continue  until  the  corrections  become  negligible. 
This  is  the  procedure  here  followed  except  that  at  times  several 
corrections  were  made  before  the  next  recalculation.  The  making 
of  several  corrections  has  led  to  a  rather  rapid  convergence  toward 
the  ultimate  values,  but  the  writer  hesitates  to  propose  rules  which 
may  be  universally  trusted  in  determining  whether  convergence 
takes  place  when  several  corrections  are  made  at  a  single  time.  The 
values  of  the  factors  thus  finally  obtained  are  given  in  Table  XII, 
chapter  iv.   From  the  standpoint  of  a  strictly  accurate  least-square 
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solution  the  writer  believes  that  these  are  correct  to  two  decimal 
places.  This  does  not  mean  that  the  probable  error  is  in  the  third 
decimal  place.  The  value  of  the  probable  error  is  not  known,  but  it 
may  well  be  in  the  neighborhood  of  .08.  It  is  probably  larger  for 
the  small  factor  values  than  for  the   larger  ones. 

The  mathematical  functions  here  dealt  with  lead  directly  into 
the  field  of  w-dimensional  trigonometry,  and  are  undoubtedly  ame- 
nable to  more  extensive  and  refined  treatment  than  has  here  been 
given  to  them.  The  writer  is  unable  to  say  that  the  specific  31  cells 
of  Table  XI,  page  103,  which  have  entries  in  them,  are  the  only  31 
which  could  be  chosen  and  yield  as  excellent  a  fit  as  is  shown  by 
Table  XIII.  He  believes  this  to  be  the  case  because  (a)  starting 
out  with  other  initial  cell  values  and  following  the  procedure  of 
•correction  already  described  there  seems  to  be  a  convergence  toward 
these  single  final  values;  also,  (b)  choosing  cells  either  singly  or 
in  pairs  by  chance  and  values  therefore  by  some  arbitrary  rule  ( for 
example,  every  value  entered  or  taken  out  of  a  cell  shall  be  of 
magnitude  .3  for  the  first  100  entries,  of  magnitude  .2  for  the  next 
100,  of  magnitude  .1  for  the  next  100,  of  magnitude  .05  for  the 
next  100,  etc.,  and  entering  or  taking  out  values  depending  upon 
whether  the  process  decreases  or  increases  the  sum  of  the  square 
errors)  seems  to  lead  to  the  same  net  result.  The  expression 
"seems  to  lead"  has  been  used  instead  of  "does  lead,"  because  the 
arithmetical  labor  of  this  process  (b)  is  so  great  that  the  writer 
has  not  carried  such  a  calculation  to  a  determinate  conclusion.  The 
tendency,  however,  seems  clear,  and  he  hopes  later,  either  by  em- 
pirical or  more  conclusive  analytical  means  to  show  that  when  the 
number  of  cells  to  be  filled  is  fixed  there  is  a  unique  solution  to  the 
problem,  which  are  the  cells  and  what  are  the  values  within  them 
in  order  to  obtain  a  minimal  square  error  of  estimate. 

We  have  now  noted  all  of  the  basic  mathematical  techniques 
which  we  will  need  to  employ  except  the  calculation  of  the  mean 
of  the  tetrads  involving  a  given  pair  of  variables  and  the  calcula- 
tion of  the  standard  error  of  such  a  mean  tetrad.  The  calculation 
of  the  mean  tetrad  itself  is  very  simple  and  is  illustrated  in  subse- 
quent chapters,  but  the  calculation  of  a  standard  error  of  a  mean 
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tetrad  is  sufficiently  involved  to  make  it  appropriate  subject-matter 
for  this  chapter  dealing  with  statistical  techniques. 

Were  one  to  choose  one  at  random  from  all  possible  tetrads 
coming  from  Table  X,  its  standard  error  would  be  given  by  For- 
mula 28,  page  49.  Let  us  consider  the  tetrad  differences  explicable 
by  the  bond  xx  x.2.  There  are  30  such,  and  calculation  shows  that 
22  are  positive  and  8  are  negative.  If  we  take  any  one  of  these 
thirty  at  random,  its  probable  error  is  given  by  Formula  28,  pro- 
viding our  choice  of  this  xt  x2  bond  is  a  random  choice.  Should 
each  of  thirty  people  choose  a  tetrad  by  chance  and  in  such  a  manner 
that  all  tetrads  were  finally  chosen,  and  should  each  draw  a  con- 
clusion as  to  the  significance  of  the  tetrad  difference  found,  widely 
different  inferences  as  to  the  reality  of  an  x1  x2  bond  would  be 
made,  but  the  median  of  these  thirty  conclusions  would  be  the 
conclusion  drawn  by  the  person  who  had  investigated  the  median 
tetrad  difference.  His  con-elusion  is  the  most  trustworthy  one  if 
a  conclusion  is  to  be  drawn  from  a  single  tetrad.  However,  using 
but  a  single  tetrad  uses  but  a  part  of  the  data.  We  have 
*i  2  3  *  =  ri2  r34  —  ri3  r24-  While  studying  the  xx  xa  bond,  the  first 
two  subscripts  of  the  tetrad,  namely,  1  and  2,  are  fixed,  but  the 
remaining  subscripts  can  take  all  possible  permutations  of  the 
subscripts  of  the  remaining  variables. 

The  strength  of  the  xt  x2  bond  should  be  judged  by  this  total 
situation  which  involves  (n  —  2)  («  —  3)  tetrads,  where  n  is  the 
total  number  of  variables.  The  obvious  way  to  proceed  is  to  calcu- 
late the  mean  of  these  tetrads  and  its  standard  error  and  thus 
determine  the  probability  of  its  divergence  from  zero  being  signifi- 
cant. This  will  be  done,  and  as  a  still  briefer  method,  the  median 
of  these  tetrads  will  be  found  and  its  standard  error  determined. 
Such  a  procedure  should  give  us  excellent  evidence  as  to  the  pres- 
ence of  a  factor  other  than  a  general  factor  in  .\\  x2,  but  it  will 
not  yield  a  measure  of  this  factor,  nor  will  it  tell  us  whether  or  not 
there  are  several  such  additional  factors.  In  short  this  procedure 
should  be  antecedent  to  the  iteration  process  already  detailed, 
pages  80-83. 

The  line  of  argument  is  straightforward,  but  there  is  a  very 
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real  difficulty  in  following  it  out,  due  to  the  algebraic  -complexity 
and  length  of  the  standard  error  formula  for  the  mean  of  the 
(w  —  2)(w  —  3)  tetrads.  Since  every  tetrad  is  correlated  with 
every  other,  the  ordinary  formula  for  the  mean  of  {n  —  2)  (w  —  3) 
correlated  measures  is  an  expression  having  [(n  —  2)  (n  —  3)]2 
terms,  each  term  being  a  polynomial  of  four  terms.  All  expanded 
terms  except  the  square  terms  involve  correlations  between  corre- 
lation coefficients  which  are  in  themselves  lengthy  algebraic  expres- 
sions. It  is  thus  clearly  out  of  the  question  to  calculate  such  a 
standard  error  without  resorting  to  approximations.  One  would 
expect,  however,  to  obtain  fairly  good  results  if  terms  are  classified 
by  type  and  approximations  obtained  for  each  type,  providing  the 
basic  table  of  correlations  is  fairly  homogeneous,  for  example, 
composed  of  positive  coefficients  all  lying  substantially  between  .0 
and  .7,  as  do  the  correlations  of  Table  X.  A  standard  error  for- 
mula applicable  under  these  conditions  is  derived  herewith.  We 
will  determine  the  standard  error  of  the  mean  of  the  tetrads  in- 
volving the  x\  x2  bond.  Let  n  equal  the  number  of  variables.  Let 
subscripts  i,  j,  k,  h  identify  variables  other  than  x1  and  x2.  There 
will  be  no  repeated  subscripts.  Thus  Sr^  does  not  include  a  term 
Th  or  rjj.  Since  x2  enters  into  the  situation  in  exactly  the  same 
manner  as  xv  we  will,  when  designating  the  averages,  use  a  sym- 
bol with  the  subscript  1  to  stand  for  the  average  of  terms,  having 
a  subscript  1  or  the  subscript  2.  Letting  M,  M',  etc.,  stand  for 
the  number  of  things  of  the  type  in  question,  we  will  employ  the 
following  averages : 

r1  =  ^(rli  +  r2i) [59] 

r-^(Sf«) [60] 

Let  ?ij  equal  the  true  nj  value,  and  let  ha  =  rtJ-  —  f,,-.  Let  the  5's 
with  other  subscripts  be  similarly  defined.  We  may  designate 
product-moments  as  follows : 

pim  =  7f77,s(8<i  M   [61] 
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and  similarly  for  the  other  product-moments.    In  the  case  of  re- 
peated subscripts  we  have 


In  this  case  we  will  not  use  the  p  notation  but  the  more  condensed 
o2  notation.  As  the  variances  of  the  various  correlation  coefficients 
will  not  differ  greatly,  we  will  use  the  average  in  place  of  the 
separate  values.  We  have  two  types  of  product-moments:  (a)  one 
subscript  repeated;  (b)  no  subscript  repeated.  The  average  of  all 
of  the  first  type  we  will  designate  by  the  letter  q,  and  the  average 
of  those  of  the  second  type  by  the  letter  p,  and  we  will  use  these 
average  values  throughout  in  place  of  the  separate  values.  Thus 
the  symbols  that  will  enter  into  the  standard  error  formula  are : 

n,  the  number  of  variables 

r12,  the  correlation  between  xx  and  x2 

flf  the  mean  correlation  between  xx  and  one  other  variable  not 
x2,  or  that  between  x2  and  one  other  variable  not  xx 

r,  the  mean  correlation  between  two  variables  neither  of  which 
is  xx  or  x2 

a2,  the  mean  of  the  variances  of  the  correlation  coefficients 

q,  the  mean  product-moment  of  the  errors  in  two  correlation 
coefficients  which  involve  three  variables  only 

p,  the  mean  product-moment  of  the  errors  in  two  correlation 
coefficients  which  involve  four  variables 

Finally,  there  will  enter  AT  (do  not  confuse  with  n),  the  size 
of  the  population. 

Let  *i  2  =  average  tetrad,  then  we  have 

tl  2  =   (n  — 2)  (n-3)  ^  2  3  4  +  h  2  4  3  +  **  2  3  5  +  "  "  " 

T  *1  2  3  It  T  '1  2  n  3  T  'l  2  4  5  T   'l  2  5  4  T    ■     •     •     T   'l  2  II  4 

+  (l2»  +  fl265+ ) [62] 
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To  generalize  this,  let  us  designate  subscripts  3,  4,  5,  6,  .  .  .  by  i, 
if  only  one  such  is  involved,  by  i  and  /  if  two  such  are  involved, 
and  by  i,  j,  k,  and  h  if  four  such  are  involved.  Let  A12  represent 
an  error  in  t1 2.  Let  A1234  represent  an  error  in  t1 2  3  4,  etc.  With 
this  notation  we  have 

A12  =  — — - — ; r-r  (Ai2ij  +  &12ji   ~T  &12ik   "T  &12ki 

(w  —  2)    (w  —  3) 

+  .  .  .  +  A12Wi  +  A12Wfc  +  .  .  . ) 

Squaring  both  sides,  and  summing  and  dividing  by  the  population 
M"  will  yield  the  variance  desired. 

(„-2)2(n-3)2o\2 

=  -ttjj  2A212i;- [(n  —  2)  (m  —  3)     summations 

each  of  this  sort] 

+  -TJJ-,  2A12ij  A12Ji ...[(«  —  2)  (n  —  3)    summations 
each  of  this  sort] 

+  jL  2A12ii  A12„. . .  [(n  -  2)  (*  -  3)  (»  -  4)  (»  -  5) 

summations  each  of  this  sort] 

+  —  2A12<j  A12fcft. . .  [4(«  —  2)  O  -  3)  (w  -  4)    sum- 
mations each  of  this  sort] [63] 

For  brevity  let  us  designate  the  four  different  types  entering  into 
the  right-hand  member  of  the  equation  by  A,  B,  C,  D.  We  must 
expand  and  sum  each  of  these. 

A  =  W'  ^12ij  =  W'^r"  bij  +  Vii  8l2  ~~  ru  b*'  ~  r'2i  8ii^2 

A  =  -^  [r\2  258<y  +  r*tf  28212  +  r\,  2822i  +  r22J-  28'n 

+  2r12  r{j  2812  bij  —  2r12  ru  282J-  bi}  —  2r12  r2j  28l4  8«j 
—  2rlt  rij  2812  82;  —  2r2J-  r{j  2812  8k  +  2rlf  r2j  28u  82j] 
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A  =  r\2  o2  +  r2o2  +  2r2x  o2  +  2r12  rp  —  2r12  rx  q  —  2r12  r,  q 

—  2rx  rq  —  2r1  rq  +  2r21  p 

A  —  r212  o2  +  2r21  o2  +  r2o2  —  4r12  rrq  +  2r12  rp  +  2r\  p  —  4rxr  q 

We  similarly  find 

B  =  r212  o2  +  r2  o2  —  4r12  rx  q  +  2r12  r  p  +  4r2x  g  —  4r,  r  g 

and  similarly 

C  =  r2x  o2  +  r2  o2  —  2r12  rx  q  +  2r12  r  />  +  2r2!  p  -\- r21  q 

+  r212  g  —  2r12  rx  p  —  Arx  r  q 

and  similarly 

D  =  r2  a2  —  4rx  r  q  +  2r12  rp  +  2r2x  p  +  2r2x  q  +r212 p  —  4r12  ra  p 

Summing  these  four  expressions,  taking  each  the  appropriate 
number  of  times,  i.e.,  to  one  A  there  is  one  B,  and  there  are 
(n  —  4)  (n  —  5)  C's  and  4(m  —  4)  D's,  we  obtain  for  the  variance 
of  the  mean  of  all  the  t12  i ,  tetrads  the  value 

°2-  =  {(„-2)1(n-3)}  ^'=  *"  +  ("2  -  9"  +  22)  ^ 
+  (W2  _  5„  +  6)  r2  o2  +  («2  -  9m  +  20)  r212  g 
+  (4m  —  16)  r212  />  —  (2»2  —  18m  +  48)  r12  rx  q 

—  (2m2  —  2m  —  24)  r12  rx  />  +  (2m2  —  10m  +  12)  r12  r  p 
+  (m2  —  n  —  8)  r2!  g  +  (2»2  —  10m  +  10)  r2x  p 

—  (4m2  -  20m  +  24)  rx  rq] [64] 

Let  us  write  this  equation  in  vertical  array  and  supply  numerical 
values  for  the  coefficients  given  by  the  terms  for  different  values 
of  m,  thus  making  it  readily  available  for  determining  the  standard 
error  of  the  mean  tetrad  for  situations  having  different  numbers 
of  variables. 
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TABLE  VII 
Coefficients  of  the  Terms  in  the  First  Column  Corresponding  to  the 
Number  of  Variables  Indicated  in  the  Captions  of  the  Other  Columns 


4 

5 

6 

2 

2 

2 

2 

2 

4 

2 

6 

12 

0 

0 

2 

0 

4 

8 

—8 

—8 

—12 

0 

—16 

—36 

4 

12 

24 

4 

12 

22 

2 

10 

22 

—8 

—24 

^8 

r 

% 

Vv± 

- 

8 

1) 

10 

11 

12 

2 

2 

2 

2 

2 

14 

22 

32 

44 

58 

30 

42 

56 

72 

90 

12 

20 

30 

42 

56 

16 

20 

24 

28 

32 

—32 

—48 

—68 

—92 

—120 

—88 

—120 

—156 

—196 

—240 

60 

84 

112 

144 

180 

48 

64 

82 

102 

124 

58 

82 

110 

142 

178 

-120 

—168 

—224 

—288 

—360 

%o 

& 

%6 

Vb 

%o 

LJ 


»"l2°Z     • 

r21  a2  . . 
r2  o2  ... 
r212q  .. 
r\2p  .. 
r12  r,  <?  . 

''i2ri/' 
r12r/>    . 

r2i  <7  •  •  •  ■ 

r\p  .... 

r1rq    .. 

Value  of  the 
term 

1 

(n-2)   (7i-3) 


20 

6 

12 

—20 

—60 

40 

34 

38 

—80 


2 

74 

110 

72 

36 

—152 

—288 

220 

148 

218 

-^40 


It  is  necessary  to  adopt  some  reasonable  procedure  to  obtain 
the  approximate  values  of  the  variables  entering  into  this  standard 
error  formula.  The  values  r12,  rlt  and  r  have  already  been  specifi- 
cally defined.  The  variance  of  a  correlation  coefficient  is  o2.  We 
desire  a  single  value  for  this  which  we  can  use  in  place  of  the 
large  number  of  slightly  different  values  which  in  reality  enter 
into  the  formula.  In  the  calculation  of  the  standard  error  of  the 
mean  t±  2  i  j  tetrad,  r12  enters  in  as  often  as  ri;-,  and  the  two  to- 
gether as  often  as  rxi  or  r2l.  Therefore,  if  when  calculating  o2  by 
the  formula 

(l-/?')3 

0  =        N 
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we  use  for  R  the  following  value 

we  should  secure  a  very  reasonable  value  for  <r. 

The  product-moment,  where  three  variables  are  involved,  has 
been  designated  q  (the  same  as  p12-.i3  of  Formula  66).  It  may  be 
calculated  by  the  aid  of  Formula  66,  page  93.  There  are,  how- 
ever, a  very  large  number  of  different  values  of  q,  depending  upon 
which  three  correlation  coefficients  are  employed.  Considering  the 
tetrad  tx  2  i  j  we  can  have  sets  of  three  variables  as  follows :  12i, 
12/,  \ij,  2ij.  Variables  xy  and  x2  play  as  large  a  part  as  do  X\  and 
Xj.  Let  us  therefore  choose  for  the  variables  from  which  to  de- 
termine q  both  xx  and  x2  and  Xi,  this  last  to  be  chosen  from  (n  —  2) 
possible  variables,  because  its  correlations  with  xx  and  x2  approxi- 
mate rx.  Thus,  if         9         is  calculated  for  each  of  the  («  —  2) 

variables,  and  if  the  variables  are  arranged  in  order  upon  the  basis 
of  these  magnitudes,  the  median  of  them  will  presumably  be  most 
nearly  equal  to  rx.  This  will  determine  the  particular  variable  of 
the  (w  —  2)  which  is  called  Xi  for  the  purpose  of  calculating  q. 
After  determining  the  variables  we  still  have  three  values  of  q,  de- 
pending upon  the  order  in  which  they  are  taken,  as  reference  to 
Formula  66  shows.  If  q  takes  quite  different  values,  depending 
upon  which  of  the  three  orders  (a)  xif  xlf  x2,  (b)  xlt  xt,  x2, 
(c)  x2,  Xi,  xx  is  taken,  use  for  q  the  average  of  the  three.  If  in- 
spection informs  one  which  of  these  three  values  of  q  will  be  the 
median,  then  that  one  may  be  taken  in  place  of  the  mean  of  the 
three,  thus  shortening  the  calculation. 

The  product-moment  p  given  by  Formula  65  involves  four 
variables,  xx  and  x2  playing  as  large  a  part  as  X\  and  Xj. 

Thus  two  of  these  four  variables  should  be  xx  and  x2.  The 
other  two,  X\  and  xj,  should  constitute  a  fair  sampling  of  the 
(n  —  2)  variables.  Let  us  therefore  choose  them  on  the  following 
basis:  As  above,  arrange  the  («  —  2)  variables  in  the  order  of 
the  magnitude  of  the  quantities  ru  ~*"  r-*  .    We   will   then   choose 
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the  variables  yielding  the  lower  and  upper  quartile  values,  as  Xi 
and  Xj.  If  p  takes  quite  different  values,  depending  upon  which  of 
the  three  orders  (a)  x1}  x2,  xi}  x,,  or  (b)  xlt  xiy  x2,  xj;  or  (c)  xlf 
Xj,  x2,  xi  is  taken,  use  for  p  the  average  of  the  three.  As  in  the 
case  of  q,  the  median  of  these  three  values  may  be  taken  in  place  of 
the  mean  if  inspection  informs  one  which  is  the  median. 

The  procedure  described  should  enable  one  to  tell  whether  an 
obtained  x1x2  bond  is  to  be  accounted  for  by  chance.  In  many 
cases  the  existence  of  a  bond  which  is  not  due  to  chance  is  rela- 
tively so  certain  that  we  may  investigate  the  median  tetrad  differ- 
ence instead  of  the  mean  difference,  and  if  the  difference  is  so 
small  that  we  need  its  probable  error,  we  can  multiply  that  given 
for  the  mean  tetrad  difference  by  1.25  and  have  a  good  approxima- 
tion to  the  probable  error  of  the  median  tetrad  difference.  Though 
medians  have  been  employed  quite  extensively  in  the  succeeding 
chapters,  they  are  not  to  be  preferred  to  means.  Following  the  pro- 
cedure described  yields  a  standard  error  of  .018  for  .019,  the  mean 
xxx2  tetrad  difference,  for  the  data  of  Table  X. 

Formulas  for  the  calculation  of  certain  product-moments. — 
There  are  many  situations  when  the  correlation  between  two  cor- 
relation coefficients  is  needed.  However,  in  general,  it  is  not  rfl2  rj4 
which  is  needed  but  the  product-moment  ori2  af3i  rfl2  r3i.  This 
product-moment  is  a  function  of  the  population  as  well  as  of  the 
inter-correlations  between  the  variables.    Since 

1  —  r2 
Or  = 


we  may  take  1/AT  out  as  a  factor  of  the  entire  product-moment  and 
designate  the  balance  by  p12:3i,  thus 

°ri2  aru  rr12rS4  =  -rr  ( 1  —  f  12)    (1  —  ^Zi)  ffla  ru  =-*fpi2:34. 

If  we  expand  this  product-moment  we  have 

Piz:si  =  ^18  r2i  ~T"  rli  r2Z 

—  (r12  r13  rlt  +  r12  r23  r2i  +  r18  rM  r34  +  r14  r24  r3i) 

+  4rM  r3i  {r\2  +  r214  +  r\z  +  r234) [65] 


THEORY  AND  TECHNIQUE  93 

The  general  product-moment  is,  as  shown,  a  function  of  six 
correlation  coefficients,  and  it  is  therefore  something-  of  a  task  to 
calculate  the  fifteen  such  that  are  required  in  the  formula  for  the 
standard  error  of  a  pentad  function.  When  this  particular  product- 
moment  is  needed  [65]  must  be  employed  to  get  it. 

In  many  cases  a  product-moment  of  the  type  p12:13  is  required. 
If  we  let 

a  =   Tl2  Tls  ,  and  6=1-  r212  -  r\3 

this  may  be  written 

^12:13  =  -ab  +  r,z  b  +  r2,s  a [66] 

This  is  a  convenient  equation  to  use  in  the  calculation  of  p12-.i3, 
which  is  the  quantity  called  q  in  Formula  64.  No  less  than  thirty 
product-moments  of  this  sort  are  required  in  the  calculation  of  the 
standard  error  of  the  pentad  function. 

Method  for  determining  the  optimum  scoring  scheme. — In  a 
test  such  as  the  arithmetic  computation  speed  test,  a  number  of 
possible  scoring  schemes  seem  more  or  less  reasonable.  Let  X 
equal  the  number  of  attempts  or  responses,  Y  the  number  of 
errors  or  incorrect  responses.  Then  the  score  might  be  X,  the 
number  of  attempts,  or  (X  —  Y),  the  number  of  correct  responses, 
or  (X  —  2Y),  the  number  of  correct  responses  minus  the  number 
of  incorrect  responses,  or  still  some  other  combination.  If  the 
optimum  combination  of  X  and  Y  is  linear  we  may  set  the  score  as 
equal  to  (X  -f  cY),  where  c  is  an  undetermined  constant,  and 
then  search  for  an  appropriate  condition  to  impose  which  will  give 
us  the  best  value  of  c.  If  we  have  a  criterion  measure,  the  value 
of  c  giving  us  the  highest  multiple  correlation  with  the  criterion 
will  be  the  best  value.  If  we  do  not  have  a  criterion  measure  we 
may  impose  the  condition  that  c  shall  take  the  value  that  gives  the 
resulting  score  (X  +  cY)  the  highest  reliability.  This  is  the  con- 
dition that  has  here  been  used  to  determine  the  fitting  combination 
of  sub-scores,  the  number  attempted,  the  number  right,  number 
wrong,  number  omitted,  etc.,  to  yield  a  single  score  for  the  entire 
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test.  If  x  and  y  stand  for  (X  —  Mx)  and  ( Y  —  My),  respectively, 
and  if  the  subscripts  1  and  3  refer  to  the  sub-scores  on  the  first 
form,  and  subscripts  2  and  4  to  the  sub-scores  on  the  second  form 
of  the  test,  then  the  correlation  which  is  to  be  a  maximum  is  that 
between  {x1  +  cy3)  and  {x2  -f-  cyu).  It  is  given  by  the  following 
equation : 

f(l  +  C3)    (2  +  C4) 

2;i-i  x2  +  cHx1  y4  +  c2y3  x2  -f  c22y3  y4 


V2^2i  +  2c2*!  ;y3  +  c2  2y23    V  2;r22  +  2<:2^2  y4  +  c2  2y24 
Using  the  usual  notation  in  which 

2.r2x  f  023  =  2y^  ?  etc<>  ^  =  jLr^r,  ?        =  Sjyb    ^ 


o 


TV  A  AT  AT 

/>12   +   C    (/>14   +   />2s)    +   C2p3 


(1  +C3)    (2  +  C4)- 


Vo2i  +  2cp13  +  c2  o23  Vo22  +  2cp2i  +  t2o24 


If  we  take  the  derivative  of  this  function  and  set  it  equal  to  zero, 
we  will  be  able  to  determine  the  value  of  c  which  makes  it  a  mini- 
mum. The  required  derivative  is  a  quartic  in  c  as  follows  : 

o2i  o22  (p14  +  p23)  —  p12  (o2!  pit  +  o22  p13) 

+  [202!  022  p3i  +  (O2!  />24  -f  o22  p13)   (p14  +  p23) 

-  pi,  (o\  o\  +  a22  o23  +  4/>18  p2i))c 

+  [3 (a2x  />24  +  o22  />13)  />84  —  3(o23  />24  +  o24  />13)  />12]c2 

+  [(a2x  o24  +  o22  o23  +  4/>13  />24)  />34 

—  023  ^24  +  a24  p13)  (/>14  +  p23)  —  2o23  o24  p12]  c3 

+  [  (o23  p24  +  o\  p13)  p34  -  o23  o24  (/>14  +  pm)]c*  =  0   ...  [67] 

In  almost  all  equations  this  quartic  has  been  found  to  have  two 
imaginary  roots.  In  fact  if  we  have  similar  forms,  so  that  xx  and  x2 
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are  similar  measures,  and  also  x3  and  x\,  then  r12  and  r34  are  each 
greater  than  zero,  and  they  bear  such  a  relationship  to  the  other 
correlation  coefficients  that  the  quartic  then  has  only  two  real  roots. 
One  of  the  real  roots  gives  the  value  of  c  for  which  the  reliability 
is  a  maximum,  and  the  other  for  which  it  is  a  minimum. 

Though  Equation  67  was  used  a  good  many  times  in  getting 
optimum  combinations  for  the  third  and  seventh  grades  separately, 
as  reported  in  chapter  viii,  differences  between  these  optimum 
reliabilities  and  those  resulting  from  non-fractional  weightings  of 
the  sub-scores  were  in  all  cases  so  small  as  not  to  warrant  the  use 
of  the  longer  though  more  reliable  scoring  scheme.  The  technique 
for  determining  the  optimum  relationship  between  "rights"  and 
"wrongs"  (and  at  times  also  "omissions")  gave  throughout  very 
reasonable  results.  Most  of  the  scoring  schemes  adopted,  because 
they  contained  integral  weights  and  differed  but  slightly  from  the 
optimum  schemes,  are  such  as  might  readily  have  been  hit  upon  by 
common  sense,  or  whatever  it  is  that  guides  one  in  the  absence  of 
data. 

Under  many  conditions  a  somewhat  simpler  expression  than 
[67]  may  be  used  to  determine  the  optimum  scoring  scheme.  If 
the  two  forms  are  genuinely  similar,  then,  to  a  close  approximation 
we  may  say  that 

7*14  ==  ^23 

f«  =  Y2i 
O2!   =   022 

023    =    024 


Thus  if  we  write 


q-  = 
Qia  = 


o-3 

0-4 

o\ 

o2o 

ru 

+ 

r23 

2 

ria 

+ 

r2* 
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Equation  67  becomes 

2oi4  —  2q13  r12  +  qc  [2r34  +  4o13  q14  —  (2  +  4q213)  r12] 
+  3g2  c2  [2q13  r34  -  2q13  r12]  +  g3  c3  [(2  +  4q213)  r34 
-  4q13  q14  -  2r12]  +  g4  c*  [2q13  r34  -  2q14]  =0 [68] 

The  accompanying  tables  of  correlations  and  standard  devia- 
tions used  in  determining  the  scoring  scheme  as  given  in  chap- 
ter viii,  page  153,  may  be  utilized  by  one  desiring  practice  in  the 
use  of  this  method. 

TABLE  VIII 

Means,    Standard    Deviations,    and    Correlations    for    Determining 

the  Optimum  Scoring  Scheme  for  the  Arithmetic  Speed  Test 

for  the  Population  of  140  Seventh-Grade  Pupils 


Form  A 
Attempts 

Form  B 
Attempts 

Form  A 
Errors 

Form  B 
Errors 

69.96 

14.67 
.8229 
.1495 
.0661 

79.79 
19.11 

.0916 
.1901 

.729 
.925 

.4191 

1.386 

2.371 

Form  B   Errors 

The  equation  to  be  solved  according  to  [67]  is 

290,600  +  212,700  c  +  5,840  c- 

+  829.4  c3  +  1.591  c4  =  0 

which  gives 

(attempts  —  1.41  errors) 

as  the  scoring  scheme  yielding  the  highest  reliability. 


CHAPTER  IV 

THE  FACTORS  FOUND  IN  THE  SEVENTH-GRADE 
POPULATION  OF  140 

Many  suggestions  of  independent  mental  traits  are  given  in 
chapter  i,  and  in  chapter  iii  certain  statistical  tools  for  establishing 
the  independence  or  similarity  of  different  measures  are  described. 
This  chapter  reports  an  experimental  investigation  which  utilizes 
the  methods  of  chapter  iii  in  an  analysis  of  tests  selected  because 
of  such  suggestions  of  independence  as  provided  in  chapter  i.  The 
tests  used  are  described  in  detail  in  chapter  viii.  When  two  or  more 
tests  are  found  to  possess  a  common  factor,  a  critical  scrutiny  of 
these  tests  and  their  method  of  administration  may  reveal  its  na- 
ture. Having  secured  an  idea  as  to  the  nature  of  the  independent 
mental  factor,  it  is  then  in  order  to  build  up  a  test  measuring  this 
factor  so  far  as  possible  uncontaminated  by  any  other  factors.  It 
is  to  facilitate  this  step  which  is  still  to  be  done  that  the  explanation 
of  the  tests  is  given  in  great  detail  in  chapter  viii.  We  will  here 
refer  to  the  tests  only  by  their  abbreviated  titles  and  indicate  why 
each  was  included  in  the  investigation.  The  tests  were  given  to  the 
various  groups  as  indicated  by  crosses  in  Table  IX.  The  population 
of  140  consisted  of  66  boys  and  74  girls,  all  in  the  seventh  grade. 
The  mean  age  was  12.94  years  and  the  standard  deviation  of  ages 
was  1.048  years.  There  was  a  negligible  difference  in  means  and 
standard  deviations  for  the  boys  and  girls  separately.  The  popula- 
tion of  109  seventh-grade  pupils  was  a  sub-population  of  the  140. 
The  two  third-grade  populations  were  sub-samples  of  an  original 
experimental  population  of  123  third-grade  children  of  mean  age 
9.13  years  and  standard  deviation  1.021  years.  The  number  of 
boys  was  70  and  of  girls  53.  Though  the  sample  of  60  is  a  select 
sample,  the  110  may  be  considered  a  mere  random  sampling  from 
the  123. 

These  particular  tests  were  chosen  expecting  that:  (a)  if  there 
is  a  verbal  factor,  as  suggested  by  Thorndike  and  others,  Tests  1 
and  2  would  betray  it ;  (b)  Tests  1,  3,  and  10  should  reveal  a  speed 
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TABLE   IX 
Table  of  Tests  Given  to  Each  Group 


Tests 

140  Seventh- 
Grade 
Children 

109  Seventh- 
Grade 
Children 

110  Third- 
Grade 
Children 

60  Third- 
Grade 
Children 

Reading — 

X 

X 

X 

x 

X 

X 

X 

x 

Arithmetic — 

X 

X 

X 

x 

X 

X 

X 

x 

Memory — 

5    Words    

X 

X 

X 

X 

X 

X 

X 

X 

7.  Meaningful  symbols 

X 

X 

X 

X 

8.  Meaningless    symbols 

X 

X 

X 

X 

Space — 

X 

X 

X 

x 

10    Speed         

X 

x 

Interest — 

X 

X 

13    Activity 

X 

factor;  (c)  Tests  2,  4,  7,  and  9  should  reveal  a  general  analytical 
capacity  (abstract  thought  suggested  by  Thorndike)  ;  (d)  Tests  3, 
4,  and  6  should  reveal  an  arithmetic  factor;  (e)  Tests  5,  6,  7,  and 
8  should  reveal  a  memory  trait;  (/)  Tests  7,  8,  9,  and  10  should 
reveal  a  manipulation  of  spatial  relationships  trait;  (g)  Tests  11, 
12,  13  should  reveal  traits  less  intellectual  and  more  of  an  emo- 
tional nature.    These  tests  have  proved  very  serviceable  for  the 
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purpose  in  hand,  though  a  better  battery  could  now  be  devised.  One 
of  the  tests,  No.  10,  proved  administratively  weak,  and  as  a  conse- 
quence only  a  part  of  the  pupils  were  tested  by  this  measure.  This 
and  the  fact  that  the  interest  tests  were  not  given  to  all  the  pupils 
accounts  for  the  reduced  populations  when  Tests  10-13  are  in- 
cluded. It  is  notable  that  some  important  traits  suggested  by  the 
work  reviewed  are  not  represented  in  these  tests.  This  was  un- 
avoidable because  of  expense,  but  a  further  study  should  certainly 
include  tests  measuring  a  number  of  additional  traits. 

The  method  followed  in  the  analysis  of  the  separate  tests  is, 
first,  to  secure  an  idea  as  to  the  location  and  strength  of  bonds, 
i.e.,  as  to  tests  in  pairs  possessing  some  feature  not  commonly 
measured  by  the  other  tests ;  secondly,  to  write  down  preliminary 
estimates  for  each  test,  of  the  standard  deviations  of  the  separate 
factors  measured  by  each ;  and,  thirdly,  to  refine  these  preliminary 
estimates  by  an  iteration  process,  securing  final  estimates  which 
more  closely  (in  the  least-square  error  sense)  describe  the  total  set 
of  given  inter-correlations.  For  the  population  of  140  seventh- 
grade  children  the  first  step  was  accomplished  by  a  technique  which 
is  both  more  involved  and  longer  than  that  used  on  other  popula- 
tions. It  is  accordingly  not  given  here  and  the  reader  is  asked  to 
take  on  faith  the  steps  followed  in  securing  the  initial  factor  values 
for  this  seventh-grade  population  of  140  and  to  judge  of  the  general 
possibility  of  securing  such  values  by  studying  the  procedure  of  the 
later  chapters.  We  are,  however,  giving  all  the  original  data  perti- 
nent to  the  study. 

The  preliminary  determination  of  the  special  bonds  existing 
between  the  variables  in  pairs  suggested  that  the  order  of  magni- 
tude was  as  follows  :  x1  x2 ;  ,r3  x4 ;  xs  x6  tied  with  .r7  xB :  xa  x.,. 
Somewhere  in  this  series,  though  not  determined  by  the  preliminary 
investigation,  should  be  found  xB  x7  and  also  x1  x3.  With  this  order 
as  a  starting-point  we  may  write  down,  as  in  Table  XI,  the  prelimi- 
nary values  for  the  various  factors  entering  into  each  variable. 

As  we  attempt  to  explain  more  exactly  the  total  situation  repre- 
sented by  the  nine  variables  we  are  immediately  at  a  loss  because 
of  the  insufficiency  of  our  statistical  technique  to  deal  with  so  many 
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variables  at  a  single  time.  To  meet  the  situation  we  will  here  make 
an  assumption  which  will  be  either  substantiated  or  discredited  by 
subsequent  steps.  In  brief,  if  this  assumption  is  unsound  it  will  so 
prove  itself  in  the  development  and  will  not  be  perpetuated  because 
of  its  entrance  at  this  point.  The  assumption  is  that  the  thing  which 
constitutes  the  general  factor  when  variables  xlt  x2,  x3,  xi  are 
studied  is  the  same  thing  as  that  constituting  the  general  factor 
when  variables  xlt  x2,  x3,  x5  are  investigated,  etc.,  for  all  other 
combinations  of  the  nine  variables,  four  at  a  time.  Variables  can 
be  built  up  such  that  one  general  factor  runs  through  xlt  x2,  x3,  x4 
and  a  second  quite  different  general  factor  through  xlt  x2,  x3,  x5 ; 
and,  as  is  of  course  obvious,  situations  can  readily  exist  where  the 
thing  that  is  the  general  factor  in  xv  x2,  x3,  x4  is  also  the  general 
factor  in  xx,  x2,  x3,  x5.  None  of  the  criteria  herein  given  dealing 
with  tetrads  reveals  whether  the  first  or  second  situation  obtains. 
Though  light  upon  this  issue  is  given  by  the  pentad  function,  still  a 
thoroughgoing  utilization  of  this  criterion  would  be  difficult  be- 
cause of  the  labor  involved  in  obtaining  necessary  probable  errors 
and  it  would  simply  make  the  issue  a  six-variable  issue  instead  of 
a  five-variable  one ;  for  we  do  not  have,  and  certainly  cannot  readily 
obtain,  criteria  for  six,  seven,  or  more  variables  at  a  time.  We  will 
then  assume  that  the  general  factor  found  in  every  set  of  four  vari- 
ables taken  from  the  nine  (in  certain  of  these  situations  there  is 
more  than  one  general  factor)  is  the  same  throughout,  so  that  every 
variable  may  be  expressed  as  is  x1  following 

xt  =  cx  a  -f  (other  special  or  general  factors)  +  (a  specific 
factor  not  chance)  +  (a  chance  specific  factor) [69] 

In  this  equation  cx  is  a  constant  and  a  is  a  variable  changing  from 
individual  to  individual,  but  remaining  the  same  for  a  given  indi- 
vidual throughout  xv  x2,  x3,  .  .  .  x0.  In  the  determination  of  "other 
special  or  general  factors"  we  shall  be  guided  by  the  findings  al- 
ready reported,  namely,  that  there  exists  a  very  strong  xx  x2  bond, 
a  strong  x3  x4  bond,  etc. 

If  when  so  doing  we  run  into  a  situation  wherein  the  a  factor 
and  the  special  factors  attributed  to  a  certain  variable  lead  to  an 
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unreasonably  high  reliability  coefficient  of  the  variable,  we  shall 
take  this  into  consideration.  What  is  an  unreasonably  high  relia- 
bility coefficient  is  not  obvious,  but  from  rather  sporadic  investi- 
gations the  writer  believes  that  when  the  specific  factors  in  mental 
tests  are  thought  of  as  being  less  than  five  per  cent  of  the  total 
non-chance  factors,  the  view  tends  to  become  unreasonable.  In 
illustration :  the  reliability  coefficient  of  x\  was  found  to  equal  .92. 

xx  —  cx  a  +  kx  b  +  qt  f  -f-  E1  +  ex  [70] 

in  which  a,  b,  and  /  are  general  or  special  factors,  E1  a  specific  non- 
chance  factor,  and  ex  a  chance  factor,  then  the  reliability  coeffi- 
cient is  given  by 

ru  =  c\  o2a  +  k\  oh  +  q\  o2f  +  o2El [71] 

or 

c2!  o2a  +  k\  oh  +  q\  o2f  =  ru  —  o2El [72] 

It  is  here  taken  that  o2El  will  hardly  be  less  than  .05rl7.  Thus  when 
the  left-hand  member  exceeds  .95rl7  the  situation  tends  to  become 
unreasonable.  If  for  any  variable  the  left-hand  member  does  not 
exceed  .95  of  the  reliability  coefficient  no  use  is  made  of  the  relia- 
bility coefficient  in  the  subsequent  treatment.  Of  the  nine  possible 
cases  only  three  tend  to  become  such  that  the  reliability  coefficient 
throws  light  upon  the  number  and  nature  of  the  factors  which  are 
present.  We  may  thus  lay  out  Table  XI  in  which  it  was  expected 
from  the  analysis  made  and  not  here  described  that  there  would  be 
entries  in  all  the  singly  starred  cells. 

Double  stars  are  to  be  found  in  five  of  the  cells.  As  established 
by  the  preliminary  analysis  the  necessity  for  entries  in  these  five 
cells  was  not  apparent,  but  later  steps  brought  out  this  need.  The 
reasons  the  preceding  analysis  did  not  discover  the  necessity  for 
these  entries  are :  (a)  the  entries  are  small  in  magnitude ;  (b)  three 
of  them  are  negative  as  shown  in  Table  XII,  thus  weakening  other 
positive  bonds  rather  than  standing  out  unequivocally  on  their  own 
account ;  and  (c)  one  of  them,  that  in  cell  d  —  x2,  though  positive, 
leads  to  an  x2x5  bond.  Such  a  bond  definitely  discovered  was 
thought  to  be  represented  by  the  b  factor  entering  into  x2  and  x5, 
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and  it  was  not  until  it  was  established  that  one  of  these  b  factors 
(see  |35  of  Table  XII)  was  negative  that  the  necessity  for  a  d  factor 
in  x2  came  to  light.  That  but  five  extra  entries  in  Table  XI  are 
required  to  obtain,  as  will  be  shown,  substantial  adequacy  in  the 
postulation  of  factors  underlying  the  nine  variables  is  noteworthy. 
It  shows  a  very  satisfactory  degree  of  accuracy  in  the  preceding 
analysis  as  well  as  its  inadequacy  in  giving  certain  details. 

TABLE  XI 
Preliminary  General  Factors 


Variables 

a  Factor: 
Maturity, 
Race,  Sex, 

Hetero- 
geneity, etc. 

b  Factor: 
Facility 

with 
Verbal 
Material 

c  Factor: 

Facility 

with 

Quantitative 

Concepts 

d  Factor: 
Memory 

e  Factor : 
Facility 

with 
Spatial 

Concepts 

/  Factor: 
Speed 

xi    

X2     

X3     

Xi     

X5     

xe    

xt    

•r8     

Xn     

*  .3 

*  .4 

*  .2 

*  2 

*  .5 

*  .5 

*  .5 

*  .5 

*  .5 

*  .7 

*  .7 

*  * 

*  .1 

*  .6 

*  .5 

*  .1 

*  .1 

*  * 

*  * 

*  .5 

*  .4 

*  .3 

*  .3 

*  * 

*  .1 

*  .2 

*  .4 

*  .4 

*  .2 

*  .3 

*  * 

The  numerical  entries  in  the  cells  represent  the  first  estimates 
by  the  writer  of  the  standard  deviations  of  the  special  factors. 
Using  these  preliminary  estimates  the  reader  will  know  that  the 
special  x1  x2  bond  is  represented  by  a  numerical  strength  of  .49 
(given  by  .7  X  .7)  ;  that  the  special  x3x4  bond  has  a  strength  of 
.30;  that  the  x5  x0  bond  has  a  strength  of  .20 ;  that  the  x7  xs  bond 
has  a  strength  of  .17  (given  by  .3  X  .3  plus  .2  X  .4)  ;  that  the  .rs  .r„ 
bond  has  the  strength  of  .16,  and  that  the  #,  x3  bond  has  the 
strength  of  .06.  There  is  also  indicated  an  x2  x5  bond  of  .07  (in 
harmony  with  the  total  32,  of  column  25,  Table  VI)  ;  and  an  .r,  x6 
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bond  of  .07  (not  in  harmony  with  the  total  0,  of  column  15, 
Table  VI)  ;  and  an  x3  xa  bond  of  .06  (not  quite  large  enough  to  be 
in  harmony  with  the  total  60,  of  column  36,  Table  VI)  ;  an  x3x0 
bond  of  .06  (not  clearly  indicated  in  Table  VI)  ;  an  x4  x0  bond  of 
.09  (given  by  .5  X  .1  plus  .1  X  .4,  and  indicated  in  Table  VI).  The 
remaining  bonds,  x5  x6,  x5  x7,  x5  xa,  x6  x7,  x6  x8,  x6  x9,  x7  x9, 
and  x8  xQ,  are  all  more  or  less  clearly  indicated  in  Table  VI.  Utiliz- 
ing these  preliminary  estimates  as  points  of  departure  in  making 
corrections  to  them,  we  obtain,  as  explained  in  chapter  iii,  the  final 
values  of  Table  XII. 

Each  entry  in  the  "Specific  Factors:  (Not  Chance)"  column  is 
such  that  combined  with  the  other  factors  for  the  given  variable  it 
will  just  yield  the  obtained  reliability  coefficient.  The  specific  factor 
for  variable  6,  V-.03,  is  of  course  an  impossible  value.  To  account 
for  it,  it  is  necessary  to  believe  that  the  obtained  reliability  is  smaller 
than  the  true  value  by  .03  or  a  larger  amount.  Such  a  change  in  the 
reliability  coefficient  is  not  unlikely  in  view  of  its  probable  error, 
which  is  .035. 

The  adequacy  of  these  values  in  the  description  of  the  total 
situation  characterized  by  the  correlations  found  is  decidedly 
great,  as  shown  in  Table  XIII.  The  distribution  of  discrepancies  in 
the  case  of  the  inter-correlation  coefficients,  i.e.,  exclusive  of  the 
reliability  coefficients,  is  given  in  Table  XIV  (page  107). 

As  a  rough  comparison  to  see  if  these  divergences  exceed  what 
might  be  expected  by  -chance,  we  may  compare  them  with  the  prob- 
able error  of  the  correlation  coefficient.  The  median  of  the  36  co- 
efficients is  .285,  and  the  corresponding  probable  errror  is  .05, 
because  the  population  is  140.  A  comparison  of  the  distributions 
of  errors  with  the  median  probable  error  would  seem  to  indicate 
that  the  fit  was  a  remarkably  good  one,  and  in  fact  the  writer 
believes  it  to  be  so,  but  he  does  not  claim  that  the  comparison  is 
logically  sound.  It  does  not  take  into  account  the  number  of  cells 
of  Table  XII  filled  with  values,  31,  in  comparison  with  the  number 
of  independent  equations  of  condition  39  (these  come  from  the  36 
inter-correlation  coefficients  and  from  reliability  coefficients  r3n], 
rnv,  and  r6vi). 


TABLE  XIII 

Table  of  Actual  and  Theoretical  Correlations 

iV  =  140 
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Correlations 

Actually 

Found 

Correlations  Which 

Would  Result 

from  Such  Factors 

as   Postulated  in 

Table  XII 

Differences 

.63 

.64 

—.01 

.24 

.24 

.00 

.06 

.11 

-.05 

.20 

.20 

.00 

.23 

.25 

—.02 

.30 

.27 

.03 

.20 

.21 

—.01 

.20 

.19 

.01 

—.06 

-.05 

—.01 

.07 

.08 

—.01 

.31 

.30 

.01 

.30 

.33 

—.03 

.33 

.33 

.00 

.25 

.24 

.01 

.28 

.25 

.03 

.42 

.43 

—.01 

.04 

.07 

—.03 

.23 

.21 

.02 

.02 

.05 

—.03 

.06 

.01 

.05 

.03 

.03 

.00 

.15 

.14 

.01 

.29 

.29 

.00 

.25 

.24 

.01 

.28 

.28 

.00 

.38 

.37 

.01 

.72 

.67 

.05 

.67 

.68 

—.01 

.47 

.52 

-.05 

.44 

.43 

.01 

.63 

.60 

.03 

.50 

.45 

.05 

.44 

.44 

.00 

.69 

.70 

—.01 

.54 

.56 

—.02 

.55 

.56 

—.01 

.92 

Greater  than      .79 

.89 

Greater  than      .67 

.91 

Greater  than      .90 

.01! 

.56 

Greater  than      .54 

.02! 

.89 

Greater  than      .76 

.63 

Greater  than      .66 

—.03! 

.85 

Greater  than      .75 

.83 

Greater  than      .77 

.88 

Greater  than      .77 
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Let  us  now  examine  Table  XII  and  its  implications  in  some 
detail.  It  must  be  understood  that  the  captions  of  the  columns  of 
Table  XII  describing  the  general  and  group  factors  a,  p\  y,  b,  e, 
and  t,  are  merely  words  giving  what  the  writer  surmises  to  be  the 
nature  of  the  factors.  Considering  the  (5  factor  of  Test  1,  a  more 
accurate  statement  of  the  case  would  be  that  there  is  an  independent 
factor  of  standard  deviation  .69  (if  the  total  standard  deviation  of 

TABLE  XIV 

Distribution  of  Differences  between  Actual  and  Theoretical 
Correlations 

Differences    as^l 

given  in  Col.  L    -.05  -.04  -.03  -.02  -.01     .00     .01     .02     .03     .04     .05 

4,  Table  XIII J 
Frequencies 20428771203 

the  variables  is  called  1.00)  in  this  test  which  is  also  in  Tests  2,  3, 
and  5.  In  Test  2  this  factor  has  a  standard  deviation  of  .70,  in 
Test  5  of  .09,  and  in  Test  3  of  .15,  but  in  this  latter  test  it  is  an 
inhibiting  factor,  tending  to  decrease  the  test  score,  whereas  in  the 
other  three  tests  it  is  a  contributing  factor  tending  the  larger  it  is 
to  increase  the  test  score.  Further,  this  same  factor  is  not  found1 
in  Tests  4,  6,  7,  8,  or  9.  The  appropriate  verbal  description  of  the 
factor  can  only  be  surmised  by  a  study  of  the  nine  tests  and  the 
selection  and  naming  of  the  element  present  in  large  amount  in 
Tests  1  and  2,  in  slightly  negative  amount  in  Test  3,  in  slightly 
positive  amount  in  Test  5,  and  absent  in  the  remaining  five  tests. 
The  writer's  characterization  of  this  as  a  "verbal"  factor  is  the 
result  of  such  a  procedure  on  his  part.  If  his  analysis  has  been 
inadequate,  the  name  which  he  has  given  to  the  factor  is  unfortu- 
nate, but  the  more  important  finding — that  a  (3  factor,  having  the 


1  This  factor  might  be  present  in  the  other  variables  to  a  very  small 
amount.  In  order  to  keep  the  number  of  cell  entries  below  the  number  of 
independent  conditions,  it  was  planned  that  cell  entries  of  less  than  .1  would 
be  called  .0.  However,  two  of  these  entries  turned  out  so  nearly  equal  to  .1 
that  they  have  been  kept.  They  are  the  entries  in  the  cells  (xv  e)  and  (.r5,  |3). 
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correlation  and  independence  properties  listed,  exists — is  not  weak- 
ened by  the  unhappy  christening.  That  the  factor  present  in  large 
amount  in  x1  and  x2  should  be  called  "verbal"  seems  reasonable, 
but  why  it  enters  negatively  in  x3  is  not  obvious.  We  may  well 
await  more  evidence  as  to  restraining  and  abetting  mental  functions 
and  success  in  school  subjects  before  attempting  a  general  or  com- 
prehensive interpretation.  However,  in  passing,  the  writer  would 
say  that  the  negative  factor  -.31,  found  in  cell  (x9,  £),  though 
entirely  unanticipated,  seems  strikingly  in  harmony  with  his  a  pos- 
teriori introspections  as  to  what  takes  place  mentally  in  the  suc- 
cessful solution  of  the  tasks  of  Test  9. 

The  y  factor,  especially  pronounced  in  x3  and  jr4,  of  some 
strength  in  .rG,  and  present  in  x9,  almost  certainly  has  something  to 
do  with  numbers  in  spite  of  its  presence  in  x0. 

Tests  5,  6,  7,  and  8  were  devised  with  a  view  to  ascertaining  if 
there  was  a  general  memory  factor.  The  5  factor  is  of  substantial 
amount  in  all  of  these,  of  small  amount  in  x2,  and  it  would  seem  in 
spite  of  the  small  negative  factor  in  x3  that  this  factor  had  much  to 
do  with  memory.  It  thus  seems  that  memory  facility  is  a  general 
factor  operating  with  reference  to  words,  numbers,  and  spatial 
material ;  in  brief,  operating  in  connection  with  all  the  material 
with  reference  to  which  tests  were  made.  The  claim  that  one  is 
possessed  of  "memories"'  rather  than  a  "memory  ability"  would 
seem  not  to  be  fully  justified.  There,  of  course,  must  be  memories 
dependent  upon  the  material  involved,  but  the  readiness  with  which 
this  material  can  be  memorized  would  seem  to  be  general.  This 
point  should  be  further  tested  in  additional  studies  by  means  of 
memory  tests  differing  more  radically  in  mechanical  make-up  and 
type  of  response  than  is  the  case  with  the  four  memory  tests  here 
employed. 

The  characterization  of  the  8  factor  as  "facility  in  the  manipu- 
lation of  spatial  relationships"  might  seem  somewhat  open  to  doubt 
in  view  of  the  fact  that  Test  9,  especially  devised  to  measure  this 
trait,  does  not  depend  upon  this  factor  to  as  great  an  extent  as  does 
Test  8.  However,  one  should  have  anticipated  that  each  of  Tests  7, 
8,  and  9  would  contain  a  spatial  factor.  One  might  not  have  antici- 


FACTORS  IN  THE  SEVENTH  GRADE  109 

pated  this  factor  in  Test  4,  although  its  presence  here  is  not  at  all 
inexplicable.  Almost  certainly  one  would  not  have  anticipated  a 
small  factor  of  this  sort  in  Test  1.  However,  in  view  of  all  these 
facts  and  of  the  fact  later  reported  that  this  factor  is  also  found  in 
Test  10  (devised  to  measure  speed  in  the  manipulation  of  spatial 
relationships)  in  the  case  of  another  population,  we  may  be  justi- 
fied in  considering  this  factor  as  very  definitely  having  much  to 
do  with  the  mental  manipulation  of  spatial  relationships.  In  the 
case  of  the  small  e  factor  found  in  x1  (Reading-Speed),  and  not 
found  in  x2  (Reading-Power),  may  it  not  be  that  there  is  in  rapid 
reading  a  visual  stimulation  and  a  corresponding  spatial  ideation 
of  words  and  parts  of  sentences  that  is  lacking  in  thought  reading, 
and  that  it  is  of  the  nature  of  spatial  manipulation?  The  value  .09 
is  too  small  to  be  anything  more  than  suggestive. 

Three  tests  were  devised  to  measure  speed :  Test  1 — Reading- 
Speed  ;  Test  3 — Arithmetic-Speed ;  and  Test  10 — Speed  in  the 
Manipulation  of  Spatial  Relationships.  The  t,  factor  is  found  in 
xx  and  x3  and  in  the  case  of  another  population  in  x10.  However, 
in  this  other  population  it  is  present  as  a  negative  factor.  This 
would  at  first  seem  ridiculous,  but  from  much  evidence  obtained 
at  the  time  Test  10  was  administered,  it  is  known  that  this  test  is 
too  hard  to  be  a  proper  speed  test  in  the  seventh  grade,  and  there- 
fore it  is  in  fact  a  power  test.  Thus  the  finding  of  a  negative  factor 
in  Test  10  is  in  harmony  with  the  finding  of  such  a  factor  in  Test  9. 
The  writer  believes  that  "speed"  is  a  proper  term  to  use  in  connec- 
tion with  this  l>  factor. 

An  examination  of  the  a  factor  discloses  some  highly  interest- 
ing tendencies.  It  has  already  been  pointed  out  that  if  a  number  of 
traits  are  genuinely  independent,  but  if  the  subjects  tested  are  dis- 
similar with  respect  to  maturity,  race,  sex,  and  general  nurture 
(i.e.,  nurture  not  affecting  a  single  trait),  a  common  factor  due  to 
this  heterogeneity  will  appear.  The  factor  has  quite  different  values 
for  the  various  tests;  but  if  we  postulate  (a)  that  the  individual 
differences  due  to  maturity,  race,  and  sex  are  less  for  tests  most 
affected  by  specific  nurture,  i.e.,  reading  and  arithmetic,  (b)  that 
as  has  been  found  in  various  studies  sex  differences  are  of  consider- 
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able  amount  with  reference  to  memory;  and  (c)  that  maturity  and 
perhaps  sex  differences  find  much  expression  in  traits  least  affected 
by  specific  nurture,  i.e.,  manipulation  of  spatial  relationships,  we 
have  hypotheses  which,  with  one  exception  (to  be  further  consid- 
ered), fairly  well  account  for  the  variation  in  values  of  the  a  factor 
for  the  nine  tests,  and  we  have  at  least  partial  justification  for  des- 
ignating this  factor  as  due  to  heterogeneity  in  maturity,  race,  sex, 
and  general  nurture.  By  hypothesis  (a)  the  factor  for  Tests  3  and 
4,  and  to  a  less  extent  for  Tests  1  and  2,  should  be  low,  and  they 
are  so  found  to  be ;  by  hypothesis  (b)  the  factor  for  Tests  5,  6,  7, 
and  8  should  be  high,  and  this  is  the  case  except  that  a  for  Test  8 
is  somewhat  too  low;  and  by  hypothesis  (c)  the  a  factor  for  Tests 
7  and  8  should  be  high,  as  is  the  case  except  that  the  a  factor  for 
Test  8  is  somewhat  low.  All  the  a  factors  except  that  for  Test  8 
fit  in  with  these  hypotheses,  and  one  additional  hypothesis  makes 
Test  8  fit  in.  Let  us  postulate  (d)  that  the  a  factor  is  really  two 
factors,  one  of  which  is  especially  influenced  by  sex,  being  for 
memory  of  the  nature  "girls  superior  to  boys,"  and  for  the  manipu- 
lation of  spatial  relationships,  of  the  nature  "boys  superior  to  girls." 
Then  we  find  that  the  two  tendencies  work  against  each  other  in 
Test  8,  and  to  a  less  degree  in  Test  7,  and  that  no  other  test  is 
affected  by  these  tendencies  jointly.  This  will  decrease  the  a  factor 
in  these  two  instances,  but  it  will  decrease  it  more  in  the  case  of 
Test  8.  Thus  with  this  added  postulation  (d)  all  of  the  a  entries 
are  consistent. 

This  analysis  of  the  a  factor  leads  us  to  wonder  whether,  had 
we  experimentally  allowed  for  maturity,  race,  sex,  and  general 
nurture,  any  a  or  general  factor  would  have  remained.  In  other 
words,  we  may  wonder  if  there  is  any  factor  at  all  independent  of 
these  things  corresponding  to  Spearman's  idea  of  a  "central  fund 
of  intellective  energy,"  or  "general  ability,"  or  "g."  To  explain 
the  a  factor  we  have  found  it  necessary  to  make  postulations  (a), 
(b),  (c),  and  (d).  Obviously  further  study  should  examine  into 
each  one  of  these.  The  data  of  the  present  study  are  not  extensive 
enough  to  warrant  such  an  investigation.  The  writer  will  also 
admit  that  the  magnitude  of  the  sex  factor  seems  to  be  much 
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greater  than  he  anticipated.  At  the  present  time  a  recomputation 
treating  the  sexes  separately  is  not  possible.  As  this  study  is  the 
first  of  its  type,  it  is  perhaps  fortunate  that  a  too  accurate  prelimi- 
nary analysis  was  not  made,  for  then  the  impression  might  be  given 
that  the  final  conclusions  were  merely  expressions  of  preliminary 
impositions.  Here  with  reference  to  sex,  again  (see  chapter  v) 
with  reference  to  an  r|  factor  (possibly  vivaciousness),  and  as  has 
been  shown  with  reference  to  a  number  of  cells  in  Table  XII,  the 
statistical  findings  demand  postulations  not  earlier  made.  The 
method  is  thus  one  of  discovery  as  well  as  of  proof.  The  next 
chapter  reports  a  study  similar  to  that  of  this  chapter,  covering 
more  variables,  but  based  upon  a  part  only  of  the  population  used 
in  this  chapter. 


CHAPTER   V 

THE  FACTORS  FOUND  IN  THE  SEVENTH-GRADE 
POPULATION  OF  109 

Four  additional  test  measures  are  available  for  109  of  the  popu- 
lation of  140  studied  in  the  last  chapter.  These  measures  are: 
Test  10,  a  test  of  speed  of  manipulation  of  spatial  relationships ; 
Test  11,  the  Wyman  Free  Association  Test,  scored  to  measure  in- 
terest in  intellectual  activity;  Test  12,  the  Wyman  test,  scored  to 
measure  interest  in  social  activity;  and  Test  13,  the  Wyman  test, 
scored  to  measure  interest  in  physical  activity.  Test  10  is  given  in 
chapter  viii.  The  Wyman  list  of  stimulus  words  for  which  free 
associations  were  secured  are  not  here  given,  because  they  would 
be  of  little  utility.  The  important  feature  of  the  three  Wyman 
interest  measures  is  not  the  stimulus  words,  to  which  the  pupils 
reacted  with  the  first  word  that  came  to  mind,  but  in  the  method  of 
scoring  these  reactions;  and  the  Wyman  scoring  scheme  is  very 
lengthy,  as  indeed  it  must  be,  for  the  number  of  reaction  words 
which  are  given  to  a  single  stimulus  word  is  very  great  and  a 
separate  score  is  necessary  for  each  reaction  word  and  for  each  type 
of  interest.  If  the  scoring  scheme  for  a  particular  interest  were 
here  copied  in  full,  it  would  be  very  difficult  for  the  reader  to  ascer- 
tain by  an  examination  of  it  what  was  the  special  nature  of  any 
unique  factor  in  it.  The  writer  well  realized  this  difficulty  at  the 
time  the  test  was  included  in  the  study,  but  these  three  measures 
were  included  because  it  was  thought  they  might  measure  traits 
quite  radically  different  from  those  measured  by  the  other  tests. 
They  were  included  in  order  to  discover  experimentally  if  the  same 
group  and  general  factors  required  for  the  explanation  of  the  ten 
tests  would  be  sufficient  to  explain  these  tests  as  well,  and,  if  not, 
to  find  out  how  many  additional  factors  would  be  needed,  rather 
than  to  determine  with  any  certainty  the  nature  of  any  additional 
factor  or  factors. 

It  should  be  said  that  the  109  were  not  quite  a  random  sam- 
pling of  the  140,  as  the  following  table  shows : 
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TABLE  XV 
Statistics  of  the  Two  Sub-Samples  of  the  Population  of  140 


Test  No. 

Means 

Number  of  Population 
140  Standard  Deviations 

Apart  of  Means  of 
Populations  of  109  and  31 

Population 
of  140 

Population 
of  109 

Population  of 
Remaining  31 

Reading — 

1.  Speed 

93.1 

93.1 

92-4 

04 

2.  Power   

194.5 

197-3 

184.6 

—  40 

Arithmetic — 
3.  Speed 

147.4 

147-2 

148.1 

.03 

4.  Power  

136.1 

136-9 

133.3 

—  21 

Memory — 
5.  Words 

112-5 

113.3 

109.7 

—21 

6.  Numbers    . . 

19.7 

19.9 

19.0 

—  27 

7.  Meaningful 
symbols  .... 

97.9 

98.4 

96.1 

—  13 

8.  Meaningless 
symbols  .... 

62.0 

62.9 

58.8 

—  18 

Space — 
9.  Power  

75-8 

77.8 

68.7 

—  37 

An  examination  of  this  table  shows  that  except  for  the  two  speed 
measures,  Tests  1  and  3,  the  31  are  about  one-quarter  of  a  standard 
deviation  inferior  to  the  109.  This  may  have  some  small  systematic 
effect,  but  we  should  on  the  whole  expect  the  same  factor  values  for 
the  population  of  109  as  for  the  population  of  140,  of  which  the 
109  are  a  part. 

The  basic  correlation  data  for  the  population  of  109  are  given 
in  Table  XVI. 

Two  entries  in  this  table  are  exceptional.  One  is  that  giving  the 
coefficient  of  correlation  corrected  for  attenuation  between  Test  11, 
Intellectual  Interest,  and  Test  12,  Social  Interest.  This  corrected 
coefficient  is  1.13.   Its  excess  over  1.00  can  only  be  interpreted  as 
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the  result  of  chance.  In  view  of  the  size  of  the  population  it  could 
quite  reasonably  be  so  attributed,  but  even  to  have  a  coefficient  of 
correlation  corrected  for  attenuation  of  1.00  between  these  two 
variables  is  extreme,  for  earlier  investigations  upon  entirely  differ- 
ent populations  have  shown  a  substantial  disparity  between  these 
two  measures.  However,  for  this  particular  population  it  is  neces- 
sary both  on  account  of  this  high  coefficient  corrected  for  attenu- 
ation and  on  account  of  factor  values  discovered,  as  will  shortly  be 
reported,  to  consider  these  two  variables,  .vu  and  x12,  to  be  prac- 
tically identical. 

The  other  surprising  value  is  the  correlation  of  .27  found  be- 
tween Tests  6  and  9,  Memory  Numbers  and  Space  Power.  The 
correlation  between  the  same  two  variables  for  the  population  of 
140  is  .44.  The  writer  has  not  attempted  to  determine  the  mathe- 
matical likelihood  of  getting,  as  a  matter  of  chance,  two  correlations 
differing  as  much  as  do  these  two  from  populations  of  140,  and  109 
drawn  in  a  random  manner  from  the  140.  The  likelihood  must  be 
extremely  small.  The  computation  of  both  these  coefficients  has 
been  checked  and  rechecked  in  order  to  rule  out  the  possibility  of 
arithmetical  error.  It  seems  to  the  writer  that  the  difference  is  an 
instance  of  an  extreme  divergence  such  as  does  occasionally  occur 
as  a  matter  of  chance.  Though  it  is  disconcerting,  it  is  only  one  of 
thirty-six  correlations  and  may  not  seriously  affect  the  general 
result  coming  from  this  population.  We  first  require  a  table  of 
tetrad  differences.  A  sample  only  of  such  is  given  in  Table  XVII. 
The  full  table  underlies  further  derived  Tables  XVIII,  XIX,  XX, 
and  XXI. 

From  Table  XVII  we  derive  a  table  (on  account  of  length  not 
reproduced  here),  somewhat  similar  to  Table  VI  of  chapter  iii,  for 
all  the  variables,  taken  two  at  a  time,  in  order  to  determine  the 
strength  of  the  bonds  between  each  pair.  The  procedure  pursued 
may  be  illustrated  by  considering  the  first  entry  of  this  unpub- 
lished table.  Reference  to  Table  XVII  shows  that  tx  2  a  4  =  -267. 
Now  t±  o  3  4  =  r12  ^34  —  ^13  ^24-  If  this  tetrad  is  positive  it  is  due  to  a 
group  bond  between  x1  and  x2,  or  between  x3  and  .r4,  or  to  negative 
bonds  between  x1  xz  or  x2  x4.   As  negative  bonds  will  later  be  in- 


TABLE  XVII 
Tetrads:    Seventh-Grade  Pupils — N=109 

(First  33  only  of  the  715  rows  in  the  full  table.) 


Key 


x1=Reading  Speed 
x2= Reading  Power 
x3= Arithmetic  Speed 
x.= Arithmetic  Power 

4 

x5= Memory — Words 
jr6=Memory — Numbers 
;r7=Memory — Meaningful  Symbols 


xg  =Memory — Meaningless    Symbols 
.r9  =  Space — Power 
4r10=Spatial  Manipulation  Speed 
.^.^Intellectual  Interest 
;r12=Social  Interest 
:tr13=Activity  Interest 


Variables 
abed 


1234 

1235 

1236 

1237 

1238 

1239 

12310 

12311 

12312 

12313 

1245 

1246 

1247 

1248 

1249 

1  2  4  10 

12411 

12412 

12413 

1256 

1257 

1258 

1259 

12510 

12511 

12512 

12513 

1267 

1268 

12  69 

1  2  6  10 

12611 

12612 


rab  rcd 


•  282 

.044 
.183 
.059 
.061 

—  009 
.010 

— 037 

—.002 

.128 

•  097 
.156 
.181 
.203 
.193 
.181 

—  .028 
.033 
.046 
.449 
.449 
.319 
.250 
.189 
.181 
.145 
.047 
.412 
.321 
.176 
.165 
.064 
.063 


rac  rbd 

rad  rbc 

.015 

.002 

.071 

.010 

.057 

.010 

.061 

•  012 

•  057 

.010 

•  061 

.009 

.051 

•  007 

.114 

.013 

•  111 

.014 

.024 

•  001 

.015 

.015 

.012 

.015 

.013 

.019 

.012 

.015 

.013 

•  013 

.011 

.011 

.023 

.021 

.023 

.021 

.005 

.001 

.057 

.073 

.061 

.092 

.057 

.073 

•  061 

.065 

.051 

•  054 

.113 

.100 

•  111 

.102 

.024 

.007 

•  063 

.074 

.059 

•  059 

.062 

.052 

.053 

.044 

.117 

.081 

.114 

.082 

.267 

•  027 
.126 

•  002 
.004 
.070 
.041 
.152 
.113 
.104 
.082 
.144 
.168 
.191 
.180 
.170 
.051 
.010 
.041 
.392 
.388 
.262 
.189 
.138 
.068 

•  034 
.023 

•  349 
.262 
.114 
.112 
.053 
.051 


tab  d  c 


.280 
.034 
.173 
.047 
.051 
-.018 

•  003 
-050 
-016 

.127 
.082 
.141 
.162 
.188 
.180 
.170 
-049 
.012 
.045 
.376 
.357 
.246 
.185 

•  135 
.081 
.043 
.040 

•  338 
.262 
.124 
.121 

-.017 
-.019 


'a  c  d  b 


•  013 

•  061 
.047 
.049 
.047 
.052 
.044 
.101 

•  097 
.023 
.000 

-.003 

-006 

-003 

.000 

.000 

.002 

.002 

.004 

-016 

-031 

-016 

-004 

-003 

.013 

.009 

.017 

-011 

.000 

.010 

.009 

.036 

.032 
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ferred  from  an  absence  of  positive  bonds,  we  will  not  further  con- 
sider these  last  alternatives.  The  positive  tetrad  value  .267  is 
recorded  in  the  table  (not  here  given)  under  x1  x.,  and  again  under 
,r3  x4.  A  similar  procedure  is  followed  for  all  other  tetrads. 

If  tetrad 

f  positive,  bonds  xaxb)  and  again  xcXd  j 

ta  i  c  a  is   \  .  \  are  credited 

[  negative,  bonds  xaxc,  and  again  x^Xa  J 

f  positive,  bonds  xuxij,  and  again  xcXa  ] 

faiidcis   j  .  .  r  are  credited 

[  negative,  bonds  xaxd,  and  again  xbxc  J 

f  positive,  bonds  xaxc,  and  again  xbXd  ] 

ta  c  a  b  is   -I  ..  .  \  are  credited 

I  negative,  bonds  tfo^a,  and  again  .r6.rc   I 

After  crediting  every  tetrad  twice  to  bonds  according  to  this  scheme, 
we  have  a  new  table  of  which  Table  XVIII  is  a  summary. 

For  each  bond  the  number  of  positive  tetrads  in  excess  of  55 
gives  us  some  rough  indication  of  the  number  of  times  the  bond 
between  the  two  variables  is  not  overshadowed  by  some  other  bond. 
A  weak  bond  between  two  variables,  if  it  does  not  come  into  con- 
flict with  other  bonds,  would  lead  to  a  large  number  of  positive 
tetrads,  though  they  might  all  be  small.  The  sum  of  the  positive 
tetrads  gives  us  some  rough  indication  of  the  size  of  the  bond  or 
bonds  between  the  two  variables.  For  example,  for  xx  x2  we  have 
55  +  24  positive  tetrads,  and  for  xx  xz  we  have  55  +  26.  But  the 
sum  for  the  positive  tetrads  for  xt  x.2  is  much  greater  than  that 
for  xx  xA.  We  may  surmise  that  the  xx  x2  bond  is  numerically  larger 
than  the  x1  xz  bond,  but  that  it  is  operative  only  about  the  same 
number  of  times.  The  number  of  times  that  a  bond  is  operative  is 
approximately  given  by  the  number  of  times  that  the  other  vari- 
ables taken  two  at  a  time  do  not  involve  the  same  factor  as  that 
giving  rise  to  the  bond  in  question. 

From  Table  XVIII  let  us  list  the  bonds  roughly  in  the  order  of 
their  magnitude,  and,  for  all  bonds  involving  any  two  of  variables 
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TABLE  XVIII 

Based  upon  the  Strength  of  Special  Bonds  between  Variables  of 

the  Seventh-Grade  Population  of  109 

Note. — If  there  were  no  special  bonds  the  number  of  tetrads  per  each  pair  of  vari- 
ables would  be  55. 


Variables  in 
Pairs 


Number  of  Sum  of  All 
Positive  the  Positive 
Tetrads*        Tetrads 


Variables  in 
Pairs 


Number  of 
Positive 
Tetrads* 


Sum  of  All 

the  Positive 

Tetrads 


1,2 
1,3 
1,4 

1,5 

1,6 

1,7 

1,8 

1,9 

1,10 

1,11 

1,12 

1,13 

2,3 
2,4 
2,5 

2,6 

2,7 

2,8 

2,9 

2,10 

2,11 

2,12 

2,13 

3,4 

3,5 

3,6 

3,7 

3,8 

3,9 

3,10 

3,11 

3,12 

3,13 


55+24 
55+26 
55—34 
55—14 
55—  6 
55+  0 
55—14 
55+  5 
55+  8 
55+16 
55+19 
55-30 

55—10 
55—35 
55—  2 
55—19 
55—17 
55—25 
55+10 
55+  9 
55+28 
55+26 
55+11 

55+45 
55—10 
55+26 
55+  2 
55+  5 
55—33 
55—11 
55—48 
55—34 
55+45 


13-16 
5.31 
•  26 
1.40 
1.77 
2.78 
1.36 
1.54 
1.83 
6.02 
6.34 
.80 

.59 
.32 
2.22 
1.42 
1.53 
1.11 
2.76 
2.71 
9.48 
9.18 
2-28 


11 


93 
.94 

6.09 

1.33 

1.35 

.26 

•  54 

.03 

.14 

5-86 


4,5 

4,6 

4,7 

4,8 

4,9 

4,10 

4,11 

4,12 

4,13 

5,6 

5,7 

5,8 

5,9 

5,10 

5,11 

5,12 

5,13 

6,7 

6,8 

6,9 

6,10 

6,11 

6,12 

6,13 

7,8 

7,9 

7,10, 

7,11, 

7,12 

7,13 


55—17 
55—  2 
55+  7 
55+14 
55+25 
55+30 
55-^4 
55—  6 
55+16 


55+18 

10-41 

55+12 

7.88 

55—  8 

4.47 

55+  6 

4-22 

55—  1 

3-33 

55+15 

3-99 

55+  6 

2-99 

55—  5 

1.57 

55+12 

7-21 

55—  8 

4-76 

55—10 

2.64 

55—  2 

2.90 

55—15 

.95 

55—14 

.82 

55+20 

3.73 

55+10 

8.19 

55+13 

6.58 

55+18 

5-86 

55—9 

1.00 

55—19 

.63 

55—30 

.94 

1.27 
2.93 
3.40 
4.25 
4.93 
5.04 
.17 
.61 
1.77 


*  The  sum  of  the  entries  in  this  column  is  4,294.  It  should  be  4,290.  The  dif- 
ference comes  from  a  slight  error  in  the  table  not  here  given  from  which  this  table 
was  derived.  It  was  not  considered  of  sufficient  moment  to  warrant  a  redetermination 
of  the  faulty  table. 
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TABLE  XVIII— Continued 


Variables  in 
Pairs 

Number  of 
Positive 
Tetrads* 

Sum  of  All 

the  Positive 

Tetrads 

Variables  in 
Pairs 

Number  of 
Positive 
Tetrads* 

Sum  of  All 

the  Positive 

T'-trads 

8,9   

55+17 

55+  2 
55+  8 
55+  3 
55—  2 

55+45 
55—15 
55—21 
55^1 

6.43 
3.88 
3-36 
2-36 
1.74 

15-70 
.70 
.49 
•  33 

10,11 

55—  5 
55 — 41 
55—51 

55+41 

55+29 

55+40 

•  93 

8,10.... 

10,12 

•21 

8,11 

10,13 

•  01 

8,12 

11,12 

8  13 

19.48 

11,13 

4.50 

9,10 

12.13 

9  11 

7.37 

9,12 

9,13 

*  See  footnote  on  p.  118. 

2  to  9,  indicate,  if  possible,  the  nature  of  the  bond  as  already  re- 
vealed by  our  study  of  the  population  of  140.  In  the  second  col- 
umn of  Table  XIX,  the  nature  of  the  bond  is  suggested  very 
frequently  with  a  question  mark  as  uncertain.  Of  course  any  ex- 
planatory observation  covering  pairs  of  variables  involving  Tests 
10,  11,  12,  or  13  will  be  highly  speculative.  Certain  weak  bonds 
for  variables  1  to  9  are  suggested  in  Table  XVIII  for  which  no 
cause  had  previously  been  indicated.  In  such  case,  a  question  mark 
is  entered  in  the  second  column  of  Table  XIX. 

We  should  now  have  a  pretty  good  working  idea  of  the  bonds 
underlying  the  thirteen  variables.  From  Tables  XII  and  XIX 
preliminary  estimates  of  the  bonds  for  these  variables  were  made 
as  given  in  Table  XX  (page  121). 

The  steps  already  described  in  connection  with  the  population  of 
140  were  followed  to  secure  improved  estimates.  The  preliminary 
estimates  did  not  prove  to  be  very  close,  and  it  has  required  some 
sixty-two  successive  improved  approximations  to  secure  the  final 
estimates  of  the  following  Table  XXI,  the  entries  of  which  with 
but  few  exceptions  may  be  taken  as  accurate  to  the  second  decimal 
place.  Here  again  it  should  be  observed  that  the  probable  error  of 
these  figures  is  not  known,  but  that  it  may  well  be  in  the  neighbor- 
hood of  .09. 

Let  us  first  note  the  differences  between  the  cell  entries  in  this 
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TABLE  XIX 

Variables  in  Pairs  Approximately  in  the  Order  of  Indicated 

Strength  of  Special  Bonds — iV=109 


Variables- 
Positive 
Bonds 


Suggested  Nature 
of  Bonds 


Variables — 

Negative 

Bonds 


Suggested  Nature 
of  Bonds 


11,12 
9,10 
1,2 

3,4 

5,6 

2,11 

2,12 

3,13 

12,13 
3,6 
1,3 
7,10 
4,10 

11,13 
1,  12 
4,9 
7,8 
5,7 
6,7 
8,9 
7,9 
1,11 
6,13 
5,11 
4,8 
4,13 
2,9 
8,11 
4,7 
2,10 
2,13 
5,9 
5,12 


Verbal  ?  * 
Spatial 
Verbal  * 
Numbers 
Memory 
Verbal  ?  * 
Verbal  ?  * 


Numbers 
Speed 
Spatial  ? 
Spatial  ? 

? 

Verbal  ?  * 

Numbers  and  Spatial 

Memory  and  Spatial 

Memory 

Memory 

Spatial 

Spatial 

Verbal  ?  * 

? 

? 

Spatial 
? 

?t 
? 


Spatial 


? 
? 

?t 


10,  13 
3,11 
4,11 

10,12 
9,13 
1,4 
2,4 
3,12 
3,9 
1,13 
7,13 
9,12 
7,12 
2,8 
9,11 
6,12 
6,11 
4,5 
3,10 
2,6 
2,3 
3,5 
2,7 
7,11 
1,8 
1,5 
4,12 


Spatial  ? 


Speed 


Spatial  ? 

?t 

?t 
? 

Speed 
? 

? 

? 
? 

?t 
? 

? 

? 

?t 


?t 
Verbal  and  Memory 
Memory 

?f 

?t 
Memory  ? 


*  Since  there  are  bonds  between  the  following  pairs  of  variables,  .rn.r,.„  r,.!,,. 
x2xiv  xixtt'  xix\v  xixv  and  since  this  last  is  a  j8  or  verbal  factor,  there  is  probably  a 
j8  bond  in  xuxlv  x^x^,  x^tiv  x^x  12,  x2x12,  although  in  some,  or  all,  of  these  situations  there 
are  probably  also  other  bonds  operating. 

t  This  pair  of  variables  occurred  in  the  study  of  the  population  of  140,  but  no 
bond  of  this  nature  was  indicated  in  that  study. 
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TABLE  XX 

Preliminary    Estimates    of   the    Factors    Entering    into   the    Thir- 
teen Variables  of  the  Population  of  109 
Seventh-Grade  Children 


Tests 

Maturity 

Heterogeneity 

a 

Verbal 

Arithmetic 
7 

Memory 

6 

Spatial 
e 

Speed 

Additional 
Factor 

Especially 

in  Tests 

11, 12, 13 

V 

Reading — 
1.  Speed  . . . 

.40 

.69 

.09 

.38 

2.  Power   . . 

.38 

.70 

.20 

Arithmetic — 
3.  Speed  . . . 

.23 

—.15 

•  60 

—.17 

.66 

4.  Power   .  . 

.21 

.63 

•  31 

Memory — 
5.  Words  . . 

.66 

—09 

.56 

6.  Numbers 

.62 

.25 

.46 

7.  Meaning- 
ful symbols 

.59 

.52 

•  36 

8.  Meaning- 
less symbols 

.39 

.46 

.64 

Space — 
9.  Power   . . 

.65 

.14 

.48 

—.31 

10.  Speed  . . . 

.60 

.60 

—20 

Interest — 
11.  Intellec- 
tual     

.30 

•  50 

—.30 

—.20 

•  65 

12.  Social    . . 

.20 

.40 

—.20 

— 20 

•55 

13.  Activity  . 

.15 

.30 

—.20 

—.10 

.30 

table  and  those  in  Table  XII,  page  104,  for  the  population  of  140. 
The  negative  verbal  factor  value  of  -.09,  Table  XII,  for  Test  5, 
fell  down  to  -.05,  and  was  thus  dropped  entirely  and  does  not 
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TABLE  XXI 
Final  Factor  Values  for  Seventh  Grade — N  =  109 

(Close    of    sixty-second    successive    approximation.     Calculation    error    in    third    decimal 
place   of  about   .005.) 


Tests 

Maturity 

Heterogeneity 

a 

Verbal 
0 

Arithmetic 

7 

Memory 
8 

Spatial 
t 

Speed 

Vivacity 
V 

Reading — 
1.  Speed  . . . 

.426 

.677 

—  062 

.109 

.357 

—076 

2.  Power  . . 

.393 

.726 

.118 

.069 

Arithmetic — 
3.  Speed  . . . 

.252 

—  077 

.599 

—  181 

.643 

4.  Power  . . 

.181 

•  610 

•  324 

Memory — 
5.  Words  . . 

.677 

•  546 

6.  Numbers 

.855 

—  067 

•  209 

.453 

.124 

—  069 

7.  Meaning- 
ful symbols 

•  570 

.066 

•  516 

•  388 

—  132 

8.  Meaning- 
less symbols 

•  385 

.072 

.480 

•  595 

.084 

•  123 

Space — 
9.  Power  . . 

•  582 

•  054 

.477 

—  316 

—  176 

10.  Speed  ... 

•  602 

—  232 

.457 

—  287 

—  188 

Interest — 
11.  Intellec- 
tual 

.288 

.422 

—  147 

.112 

.724 

12.  Social    . . 

.231 

.420 

.092 

.607 

13.  Activity  . 

.094 

.238 

.112 

—  179 

.076 

.308 

appear  in  Table  XXI.  A  small  negative  verbal  factor  of  -.07  for 
Test  6  here  appears  for  the  first  time.  A  small  positive  numbers 
factor,  .07,  for  Test  8,  here  appears.  Small  speed  factors,  .12  and 
.08,  appear  for  variables  6  and  8.  There  have  also  developed  small 
factors  connecting  six  of  the  nine  variables  with  the  three  interest 
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tests.  These  are  so  small  that  they  scarcely  had  an  opportunity  to 
manifest  themselves  before  the  interest  tests  were  included.  All 
of  the  additions  and  subtractions  of  factors  mentioned,  as  well  as 
other  changes  in  amount,  are  of  minor  magnitude. 

The  addition  of  variables  10,  11,  12,  and  13  has  added  much  of 
interpretative  value.  First,  the  scores  on  the  three  interest  tests  are 
little  influenced  by  the  maturity  or  general  factor ;  second,  the  intel- 
lectual and  social  interest  measures  have  a  substantial  verbal  ele- 
ment in  them ;  third,  the  activity  interest  measure  has  a  small 
number  element  and  a  small  negative  spatial  factor ;  and  finally,  all 
three  of  the  interest  tests,  though  especially  the  social  and  intellec- 
tual interest  tests,  have  a  new  factor  in  them.  It  is  difficult  to 
surmise  what  this  new  factor  is,  because  of  the  nature  and  com- 
plexity of  the  scoring  scheme  of  these  tests.  However,  as  the  group 
upon  which  the  scoring  scheme  was  built  was  selected  by  means  of 
the  judgments  of  teachers,  the  factor  is  presumably  something  in 
children  which  tends  to  make  teachers  differentiate  them  upon  the 
basis  of  their  tendency  to  show  interest  in  something  or  other — 
not  interest  in  intellectual  activity  or  social  activity  or  physical 
activity,  but  interest  in  the  abstract,  for  it  must  be  something 
common  to  all  three  of  these  fields.  The  writer  suggests  that  it  may 
be  described  by  the  term  ebullience,  or  perhaps  vivacity.  That  it  is 
found  as  a  negative  factor  in  the  two  spatial  relationship  tests 
suggests  that  it  is  opposed  to  mental  deliberation,  which  from  intro- 
spection would  seem  to  be  an  asset  in  these  two  spatial  relationship 
tests.  Whatever  it  is,  it  appears  to  be  quite  unmeasured  by  the 
ordinary  run  of  psychological  tests,  and  thus  to  require  much  more 
study  before  it  can  be  at  all  definitely  described. 

The  test  devised  to  measure  speed  of  manipulation  of  spatial 
relationships  did  not  accomplish  this  result,  and  except  for  a  nega- 
tive memory  factor  is  very  similar  to  the  Spatial  Power  Test.  This 
negative  memory  factor  is  interesting  in  that  it  suggests  that  in  the 
tests  involving  such  activity  as  the  rapid  turning  over  in  the  mind 
of  geometrical  forms  a  native  tendency  for  a  form  to  persist  in 
the  mind  without  change  is  a  disadvantage. 

The  excellence  with  which  the  factors  listed  account  for  the 
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correlation  of  the  thirteen  variables  is  pronounced  as  shown  by- 
accompanying  Table  XXII.  For  comparison  with  the  differences 
shown,  one  should  note  that  the  probable  error  of  the  correlation 
coefficient  of  median  size  is  .06. 


TABLE  XXII 

Actual  and  Theoretical  Correlations  between  Variables  of  the 
Population  of  109  Seventh-Grade  Children — iV  =  109 


Correlation 
Coefficients 

Correlations 

Actually 

Found 

Correlations 
Which  Would 

Result  from 
Such  Factors 
as  Postulated 
in  Table  XXI 

Differences 

.66 
.24 
.05 
.24 
.25 
.31 
.25 
.22 
.18 
.34 
.35 
.02 
.04 
.06 
.29 
.24 
.25 
.24 
.25 
.21 
.47 
.46 
.10 
.42 
.07 
.28 
.09 
.09 

—.01 
.02 

-.06 

.65 
.25 
.07 

.29 
.24 
.29 
.25 
.20 
.22 
.36 
.34 
.01 
.02 
.07 
.33 
.23 
.28 
.22 
.22 
.20 
.48 
.45 
.07 
.41 
.07 
.28 
.09 
.11 

—.02 
.01 

-.07 

01 

—  01 

—  02 

—  04 

01 

.02 

00 

.02 

—.04 

—.02 

.01 

.01 

.02 

—.01 

—.04 

.01 

—.03 

.02 

.03 

.01 

—.01 

.01 

.03 

.01 

.00 

.00 

.00 

—.02 

.01 

.01 

.01 
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TABLE  XXII— Continued 


Correlation 
Coefficients 


Correlations 

Actually 

Found 


Correlations 
Which  Would 
Result  from 
Such  Factors 
as  Postulated 
in  Table  XXI 

Differences 

.01 

—.01 

.19 

.00 

.12 

.02 

.23 

.00 

.27 

.00 

.31 

—.01 

.29 

.00 

.26 

.01 

—.04 

.00 

.04 

.01 

.10 

—.03 

.64 

.04 

.67 

.01 

.52 

—.04 

.39 

—.01 

.28 

.00 

.26 

.01 

.21 

.01 

.12 

-.05 

.59 

.03 

.46 

.02 

.32 

—.06 

.22 

.03 

.11 

—.01 

.11 

—.02 

.14 

.02 

.69 

.01 

.54 

—.04 

.43 

—.01 

.12 

—.01 

.10 

—.02 

.02 

.00 

.46 

.03 

.35 

—.04 

.24 

.00 

.21 

—.01 

.04 

.04 

.69 

.02 

.03 

.01 

.03 

—.01 

r3  12 
r3  13 
r4  5 
r4  6 
r4  7 
r4  8 
r4  9 
r4  10 
r4  11 
^4  12 
r4  13 
r5  6 
r5  7 
r5  8 
r5  9 
r5  10 
r5  11 
r5  12 
r5  13 
r6  7 
r6  8 
r6  9 
r6  10 
r6  11 
^6  12 
r6  13 
r7  8 
r7  9 
r7  10 
r7  11 
r7  12 
r7  13 
r8  9 
r8  10 
r8  11 
'8  12 
r8  13 
r9  10 
r9  11 


.00 

.19 
.14 
.23 
.27 
.30 
.29 
.27 
-.04 
.05 
.07 
.68 
.68 
.48 
.38 
.28 
.27 
.22 
.07 
.62 
.48 
.26 
.25 
.10 
.09 
.16 
.70 
.50 
.42 
.11 
.08 
.02 
.49 
.31 
.24 
.20 
.08 
.71 
.04 
.02 
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TABLE  XXII— Concluded 


Correlation 
Coefficients 

Correlations 
Actually- 
Found 

Correlations 
Which  Would 

Result  from 
Such  Factors 
as  Postulated 
in  Table  XXI 

Differences 

y 

—.09 

.04 

—.02 

-.15 
.75 
.17 
.26 

.92 
.89 
.92 
.52 
.86 
.61 
.84 
.84 
.86 
.85 
.77 
.56 
.43 

—.10 

.01 

.00 
-.13 

.69 

.23 

.22 

Greater  than 

the  values 
which  follow 

.79 
.70 
.87 
.51 
.76 
.62 
.76 
.76 
.70 
.74 
.82 
.61 
.21 

01 

f 

03 

y 

—  02 

Y 

03 

'  10  13     

Y 

06 

' 11  12    

Y 

—  06 

11  13     

Y 

.04 

r 

Y 

Y 

Y .   .    

.01! 

Y*  «. 

Y 

—.01! 

r,  „ 

8  8 

Y 

Y 

Y 

-.05! 
—  05' 

Y 

Y 

As  some  of  the  test  material  proved  too  difficult  to  give  to  the 
third-grade  group,  the  seventh-grade  population  just  studied  has 
provided  us  with  more  complete  data  than  any  other  group.  We 
will,  however,  in  the  next  chapter,  study  the  factors  found  in  the 
third  grade,  particularly  with  a  view  to  ascertaining  if  with  children 
of  this  younger  age  the  same  independent  mental  traits  are  manifest 
as  in  the  seventh  grade. 


CHAPTER    VI 

THE  FACTORS  FOUND  IN  THE  THIRD-GRADE 
POPULATION 

The  first  nine  of  the  tests  which  were  given  to  the  seventh- 
grade  pupils  were  within  the  range  of  the  abilities  of  the  third- 
grade  children.  In  addition  to  these  nine  which  were  given  to  110 
pupils,  one  other  test,  No.  10,  Manipulation  of  Spatial  Relation- 
ships Speed,  was  given  to  the  same  group.  However,  only  60  of 
the  110  did  sufficiently  well  on  it  to  yield  usable  scores.  Most 
of  the  fifty  misunderstood  directions  entirely  or  at  least  did  things 
of  such  a  peculiar  nature  that  it  is  uncertain  what  they  were  at- 
tempting to  do.  Thus  for  the  select  population  of  60,  drawn 
from  the  110,  we  have  data  for  ten  tests.  Let  us  first  investigate 
the  factors  indicated  by  the  population  of  110.  The  basic  correla- 
tions of  the  variables  are  given  in  Table  XXIII. 

Tetrad  differences  for  all  combinations  of  the  variables  four 
at  a  time  are  as  given  in  Table  XXIV. 

From  Table  XXIV  a  third  table  was  derived  in  which  each 
tetrad  difference  was  credited  to  the  bonds  which  could  conceiva- 
bly give  rise  to  it.  This  table  is  not  here  reproduced,  but  a  sum- 
mary of  it  is  presented  in  Table  XXV. 

With  Table  XXV  as  a  foundation,  preliminary  estimates  of 
factor  values  were  made  as  shown  in  Table  XXVI.  These  pre- 
liminary estimates  were  altered,  leading  after  fifty-four  approxi- 
mations to  the  final  values  as  given  in  Table  XXVII. 

We  may  now  compare  the  factor  values  found  for  these 
third-grade  children  with  those  previously  found  for  the  seventh- 
grade  group.  To  facilitate  this,  Table  XXVIII  is  given,  in  which 
the  first  entry  in  each  cell  is  the  factor  value  for  the  third-grade 
population,  and  the  second  entry  is  that  for  the  seventh-grade 
group.  Unfortunately  we  do  not  know  the  standard  error  of  the 
differences  between  these  values.  It  may  reasonably,  however,  be 
in  the  neighborhood  of  .12. 

We  could  measure  the  relationship  between  these  two  sets  of 
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TABLE  XXIV 
Tetrads:    Third-Grade  Pupils — iV=110 

Key 

^•1=Reading  Speed  *5=Memory — Words 

*2=Reading  Power  ;r6=Memory — Numbers 


;r3=Arithmetic  Speed 
.*\,=Arithmetic  Power 


;r7=Memory — Meaningful  Symbols 
xg=Memory — Meaningless  Symbols 
:Spatial  Manipulation  Power 


Variables 
abed 


rab  rcd 

rac  rbd 

radrbc 

tab  cd 

.321 

.189 

•  079 

•  132 

.189 

.235 

.094 

—046 

.209 

.151 

.053 

•  059 

.158 

.134 

.059 

.025 

.163 

.042 

.001 

.121 

.189 

.138 

.068 

.051 

.285 

.131 

.124 

.155 

.261 

.084 

.070 

.177 

.288 

.074 

.078 

•  214 

.186 

.023 

.002 

.163 

.354 

.077 

.090 

.277 

.540 

.099 

•  087 

.441 

.418 

.088 

.096 

.330 

.322 

.027 

•  002 

•  294 

.310 

.091 

.112 

.219 

.439 

.049 

•  062 

.389 

•310 

.015 

.002 

•295 

.284 

.051 

.072 

•  233 

.455 

.017 

.001 

.438 

.329 

.057 

•  064 

.273 

•315 

.001 

•  020 

.313 

.164 

.061 

.122 

•  104 

.151 

.067 

.069 

•  084 

.122 

.051 

•  076 

.071 

•  107 

•  052 

.002 

•  055 

•  204 

.061 

.088 

.143 

•  311 

.079 

.040 

.232 

.241 

.060 

.045 

•  181 

.185 

.062 

.001 

.124 

.179 

.072 

•  052 

.107 

.253 

.034 

.049 

.219 

.179 

.035 

.001 

.144 

.164 

.040 

.057 

.123 

lab  d  o 


la  c  db 


1234 
1235 
1236 
1237 
1238 
1239 
1245 
1246 
1247 
1248 
1249 
1256 
1257 
1258 
1259 
1267, 
1268 
1269 
1278, 
1279. 
1289. 
1345, 
1346. 
1347. 
1348. 
1349. 
1356. 
1357. 
1358. 
1359. 
1367. 
1368. 
1369. 


.242 
.095 

•  156 
.100 
.161 
.121 
.161 
.191 

•  211 
.184 
.264 
.453 
•321 
.319 
.198 

•  377 
.309 
.212 

•  453 
.266 
.295 
.042 
.082 
.046 
.105 
.116 
.271 
.196 
.184 
.127 
.203 
.178 
.106 


.110 
.141 
.098 
.075 
.040 
.070 

•  006 
.014 

—.003 
.021 

—.013 
.012 

—008 
.026 

—021 

—012 

•  014 
—021 

•  016 

—  007 
—018 
—061 
— 001 

—  025 
.050 

—028 

•  039 
.015 
.061 
.020 

—  016 
.034 

—017 
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Variables 
abed 


rab  rcd 

rac  rbd 

rad  rbc 

.262 

.038 

.001 

.190 

.045 

.043 

.181 

.001 

.045 

•  173 

.099 

.061 

.134 

.080 

.067 

.103 

.071 

.002 

.099 

.134 

.078 

.141 

.045 

.062 

.099 

.040 

.002 

.091 

.076 

.072 

.146 

.044 

•  001 

.106 

.084 

.058 

.101 

.002 

.051 

.166 

.089 

.135 

.118 

.069 

.003 

.108 

.060 

.148 

.173 

.076 

.002 

.125 

.073 

.115 

.109 

•  002 

.088 

.097 

.073 

.003 

.070 

.067 

.121 

.067 

.002 

.085 

.074 

.002 

.125 

.120 

.106 

.223 

.110 

.117 

.144 

.089 

.089 

.127 

.078 

•  091 

.040 

.149 

.106 

.132 

.228 

.145 

.085 

.176 

.110 

.075 

.136 

.113 

.023 

.131 

.132 

.078 

.185 

.071 

.083 

.131 

.073 

.026 

.120 

.085 

.057 

.192 

•  064 

.019 

.139 

.075 

.065 

.133 

.023 

.067 

.302 

.182 

.128 

.234 

•  147 

.113 

.180 

.129 

.035 

.173 

.246 

.117 

rad  rbc  tab  c  d  *ab  d  c  *a  c  db 


1378 
1379 
13  89 
1456 
1457 
1458 
1459 
1467 
1468 
1469 
1478 
1479 
1489 
1567 
1568 
1569 
1578 
1579 
1589 
1678 
1679 
1689 
1789 
2345 
2346 
2347 
2348 
2349 
2356 
2357 
2358 
2359 
2367 
2368 
2369 
2378 
2379 
2389 
2456 
24  57 
2458 
2459 


.224 
.145 
.180 
.074 
.054 
.033 
.035 

•  095 
.060 
.015 
.102 
.022 
.099 

•  077 

•  049 
.047 
.096 
.052 
.118 

•  023 
.003 
.065 

•  073 
.015 
.007 

•  001 
.012 
.044 
.083 
.066 
.023 
.001 
.114 
.058 

•  035 
.127 
.064 
.110 
.121 
.087 
.051 
.073 


•  261 
.146 
.137 
.112 
.066 

•  101 
.021 
.079 
.098 
.019 
.144 

•  047 
.050 
.032 
.115 
.041 
.170 
.010 
.031 
.094 
.050 
.018 
.050 
.103 

•  033 
.038 
.039 
.018 
.143 
.102 
.113 
.053 
.102 
.105 

•  062 
.172 
.074 
.066 
.175 
.121 
.145 
.056 


.038 
.001 

-.044 
.038 
.013 
.069 
.056 

-.017 
.038 
.004 
.043 

•  026 
-049 
-.046 

•  065 
-.088 

•  074 
-.042 
-.087 

.071 
-053 
-.084 
-.123 
-.118 
-.027 
-039 
.051 
-026 
.061 
.035 
.090 
.054 
-012 
.047 
.027 
.045 
.010 
-043 
.054 
.034 
.094 
.129 


FACTORS  IN  THE  THIRD  GRADE 
TABLE  XXIV—  Continued 


131 


Variables               - 
abed 

brcd 

rac  rbd 

rad  rbc 

*a  b  c  d 

ta  bd  c 

ta  c  d  b 

2467 

245 
173 
159 
254 
184 
176 
305 
216 
197 
316 
229 
219 
203 
147 
141 
125 
296 
229 
176 
170 
241 
170 
156 
249 
181 
173 
142 
100 
092 
147 
106 
102 
162 
117 
112 
085 
213 
151 
138 
221 
160 
291 

.095 
.083 
.158 
.074 
.140 
.044 
.187 
.144 
.139 
.127 
.123 
.038 
.123 
.112 
.035 
.041 
.084 
.135 
.060 
.114 

•  075 
.066 
.126 

•  050 
.096 
.098 
.149 
.115 
.111 
.087 
.084 
.086 
.084 

•  077 
.079 
.091 
.186 
.143 
.138 
.116 
.112 
.098 

.103 
.032 
.072 
.026 
.087 
.076 
.214 
.066 
.221 
.051 
.171 
.132 
.054 
.180 
.127 
.186 
.102 
.077 
.079 
.092 
.071 
.072 
.126 
.059 
.068 
.060 
.146 
.150 
•  174 
.116 
.135 
.104 
.122 
.142 
.100 
.147 
.195 
.171 
.326 
.132 
■  252 
.194 

.151 

.090 
.000 
.181 

•  044 

•  132 
.118 

•  072 
.058 
.189 
.106 
.181 

•  080 
.035 

•  106 
.084 

•  212 
.094 
.117 
.056 
.165 
.104 
.029 
.199 
.085 
.074 

—  007 

—  015 

—  019 
.060 
.023 
.016 
.078 

•  041 
.033 

—  006 

•  027 
.008 

•  000 
.105 
.048 
.193 

.142 
.141 

.087 
.228 

•  097 
.100 
.091 
.149 

—  024 
.265 
.058 
.087 
.149 

—  032 
.014 

—  062 
.195 
.152 

•  097 
.078 
.170 
.097 
.029 
.191 
.112 
.113 

—  004 

—  050 

—  083 
.031 

—  029 

—  002 
.040 

—  024 
.012 

—  062 
.018 

—  020 

—  188 
.089 

—092 
.097 

—  009 

2468 

.051 

2469 

.086 

2478 

•  048 

2479 

•  053 

2489 

—  033 

2567 

—  027 

2568 

•  077 

2569 

—  083 

2578 

.076 

2579 

—  048 

2589 

—  094 

2678 

.069 

2679 

—  067 

2689 

—  092 

2789 

— 146 

3456 

—  017 

3457 

.058 

3458 

— 019 

345  9 

.022 

3467 

.005 

3468 

—  006 

3469 

.000 

3478 

—  008 

3  4  79 

.027 

3489 

.038 

3567 

•  003 

3568 

—  035 

35  69 

—.064 

3578 

029 

3579 

—  051 

3589 

—  .018 

3678 

.038 

3  679 

.065 

3  689 

.021 

3  7  89 

•  055 

4567 

•  009 

4568 

.098 

4569 

.188 

4578 

.016 

4  5  79 

.140 

4  5  89 

.096 

132 
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TABLE  XXIV— Concluded 


Variables 
abed 

rab  rcd 

rac  rbd 

rad  rbc 

ta  b  c  d 

tab  d  c 

'o  c  d  b 

4678 

.203 
.147 
.140 
.114 
.419 
.304 
.290 
.224 
.236 

.112 

.119 
.090 
.104 
.221 
.202 
.156 
.181 
•  174 

.139 

.265 
.187 
.275 
.241 

•  232 
.164 

•  240 
.220 

.091 

•  028 

•  050 
.009 
.198 
.101 
.134 
.044 
.061 

.064 

—  .118 

—.047 

—.161 

.178 

.072 

.126 

—.016 

.015 

—.027 

4  67  9 

— 146 

4689 

—  097 

4789 

— 170 

5678 

—  020 

5679 

—  030 

5689 

—  008 

5789 

—  050 

6789 

—  046 

TABLE  XXV 

Number  of  Positive  Tetrads,  Based  upon  the  Strength  of  Special 
Bonds  between  Variables  of  the  Third-Grade  Population  of  110 

Note. — If  there  were  no  special  bonds  the  number  of  tetrads  per  each  pair  of  vari- 
ables would  be  21.  Numbers  in  parentheses  indicate  number  of  positive  tetrads  of  value 
zero  to  first  two  decimal  places. 


Variables  in 
Pairs 


Number  of  Sum  of  All 
Positive  the  Positive 
Tetrads  Tetrads 


Number  of  Sum  of  All 
Positive  the  Positive 
Tetrads     i      Tetrads 


1,2 21+20 

1,3 21+16 

1,4 21+3(1) 

1,5 21+  2 

1,6 21—11(3) 

1,7 21—  7(1) 

1,8 21—21 

1,9 21—  2 

2,3 21+4(2) 

2,4 21+  3(1) 

2,5 21+  6 

2,6 21—  4 

2,7 21—  6(1) 

2,8 21—15 

2,9 21—  8 

3,4 j  21+12  (1) 

3,5 21—13  (1) 

3,6 21+0(3) 


21—16 
21+  0 
21—  3  (2) 
21—  5  (1) 
21—  8 
21—  9  (2) 
21—  4 
21+  8  (2) 
21+12 
21+  2  (1) 
21+  2(1) 
21—  6  (1) 
21+12(1) 
21+  5 
21—  5  (2) 
21+18 
21+  6(1) 
21+12 


.21 

.97 

•  74 
1.11 

.89 

•  67 
1.06 
2.89 
4.30 
2.27 
2.21 
1.07 
3.32 
2.59 
1.12 
5.26 
2-36 
3-20 
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TABLE  XXVI 

Preliminary  Estimates  of  Factors  Entering  into  the  Nine  Vari- 
ables of  the  Population  of  110  Third-Grade  Children 


Tests 

Maturity, 
Heteroge- 
neity, etc. 
a 

Verbal 
P 

Arith- 
metic 

7 

Memory 
8 

Spatial 

e 

Speed 

r 

Reading — 

1.  Speed  

A 

.7 

.4 

A 

.7 

Arithmetic — 
3.  Speed  

.2 

.1 

.5 

.6 

4.  Power    

.2 

.3 

.6 

.2 

Memory — 

5.  Words  

.6 

.6 

6.  Numbers   

.5 

.6 

7.  Meaningful  symbols 

.5 

.3 

.5 

8.  Meaningless  symbols 

.4 

—.2 

.6 

Space — 

9.  Power   

.5 

.4 

—.2 

factor  values  by  calculating  the  coefficient  of  correlation  between 
them,  were  it  not  for  the  fact  that  our  technique  has  required  that 
a  considerable  number  of  cells  in  each  table  have  zero  values  in 
them.  There  is  thus  an  imposed  tendency  for  zero  values  to  be 
found.  Keeping-  such  pairs  of  zero  factor  values,  the  correlation 
between  the  two  series  is  well  above  .90.  Even  omitting  such 
pairs  the  correlation  is  .84  (Spearman  o  value).  It  is  thus  quite 
safe  to  conclude  that  the  intrinsic  correlation  between  the  two  fac- 
tors as  found  in  the  third  grade  and  as  found  in  the  seventh  grade 
is  as  high  as  .9.  This  is  indeed  a  significant  finding.  It  not  only 
gives  us  confidence  in  the  values  found,  but  also  suggests  that  the 
factors  found  are  independent  of  the  tutelage  occurring  between 
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TABLE  XXVII 
Final  Factor  Values  for  Third  Grade — A^=110 

Note. — Close    of   fifty-fourth    successive    approximation.     Calculation    error    in    third 
decimal  place  of  about  .005. 


Variables 

Maturity, 
Heteroge- 
neity, etc. 
a 

Verbal 

Arith- 
metic 
7 

Memory 
5 

Spatial 

€ 

Speed 
I 

Reading — 

1.  Speed  

.344 

.613 

485 

2.  Power    

.618 

.755 

153 

Arithmetic — 
3.  Speed  

.359 

.361 

659 

4.  Power    

.436 

.196 

.721 

.126 

Memory — 

5.  Words   

.691 

.116 

.497 

.109 

6.  Numbers  

.541 

.139 

.632 

.189 

7.  Meaningful   symbols 

.521 

.296 

.530 

8.  Meaningless  symbols 

.550 

-.317 

.588 

Space — 
9.  Power   

.578 

.224 

.175 

grade  three  and  grade  seven,  for,  presumably,  the  third-grade 
children  are  not  radically  different  from  what  the  seventh-grade 
children  were  when  they  were  in  the  third  grade.  Of  course  edu- 
cational processes  which  have  taken  place  between  grades  three 
and  seven  have  affected  the  scores  of  the  seventh-grade  children. 
Such  influence,  however,  seems  to  have  been  of  a  nature  to  raise 
the  mean,  but  not  to  greatly  change  the  idiosyncrasies  of  the  pu- 
pils. This  is  diametrically  opposed  to  Spearman's  view  as  quoted 
in  chapter  i,  page  19.  It  thus  seems  that  the  factors  reported  are 
established  early  in  life.  In  fact  it  seems  reasonable  to  attribute 
them,  at  least  in  major  portion,  to  original  nature. 
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TABLE  XXVIII 

Factor  Values  for  Third-  and  Seventh-Grade  Pupils, 
Respectively 


Tests 

Maturity, 
Heteroge- 
neity, etc. 
a 

Verbal 

/3 

Number 

y 

Memory     Spatial 
6                 e 

Speed 

i 

Reading  — 

1.  Speed  

.34   .40 

.61   .69 

.09 

.48   .38 

.62   .38 

.76   .70 

.20 

15 

Arithmetic — 
3.  Speed  

.36   .23 

-.15 

.36  .60 

-.17 

.66  .66 

4.  Power    

.44   .21 

.20  -.09 

.72    .63 

.13   .31 

Memory — 

5.  Words   

.69   .66 

.12 

.50   .56 

.11 

6.  Numbers  

.54   .62 

.14   .25 

.63   .46 

.19 

7.  Meaningful   symbols 

.52   .59 

.30   .52 

.53   .36 

8.  Meaningless  symbols 

.55   .39 

-.32 

.46 

.59  .64 

Space — 
9.  Power    

.58   .65 

99     1d 

18     d8 

31 

Let  us  examine  Table  XXVIII  in  more  detail.  The  average 
of  the  maturity  and  other  heterogeneity  factors  is  slightly  greater 
at  the  early  age  than  at  the  later.  This  is  in  harmony  with  other 
evidence  which  commonly  indicates  a  greater  heterogeneity  in  the 
early  elementary-school  grades  than  in  the  later.  It  is  particularly 
interesting  to  note  that  the  heterogeneity  factor  has  been  decreased 
most  in  the  Reading  Power  and  Arithmetic  Power  tests,  for  these 
are  the  two  subjects  most  depended  upon  for  grading  and  promo- 
tion. We  may  surmise  that  if  our  group  had  not  been  a  school 
group  we  would  not  have  found  a  significant  difference  between 
the  two  groups  in  the  general  factor  values  in  either  the  Reading 
Power  or  the  Arithmetic  Power  tests. 

The  similarity  of  the  two  verbal  factors  in  the  two  reading 
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tests  for  the  two  grades  seems  to  be  conclusive  evidence  that  such 
a  factor  exists  and  is  of  large  amount.  It  should  be  given  an  in- 
dependent position  in  matters  of  psychology  and  learning.  That 
the  verbal  factor  is  large  in  Test  4,  Arithmetic  Power,  in  the  third 
grade  and  not  so  in  the  seventh  grade  is  not  surprising,  for  in  the 
third-grade  arithmetic  reasoning  problems,  even  though  couched 
in  quite  simple  terms,  are  in  fact  much  dependent  upon  reading 
ability.  It  is  not  obvious  what  is  the  occasion  of  the  negative 
verbal  factor  in  Test  8,  Memory  for  Meaningless  Symbols,  in  the 
third  grade. 

The  consistency  of  the  results  bearing  upon  a  number  factor 
is  impressive.  Here  again  a  psychology  of  learning  based  upon 
this  single  trait  is  needed. 

The  memory  factor,  though  in  the  main  revealing  itself  under 
the  same  conditions  for  the  two  populations,  shows  one  substantial 
difference.  The  test  entitled  "Memory  for  Meaningless  Symbols" 
does  not  seem  to  be  a  memory  test  at  all  for  the  younger  group, 
but  a  spatial  relationships  test,  and,  as  mentioned,  a  slightly  in- 
verse verbal  ability  test. 

The  manipulation  of  spatial  relationships  is  clearly  a  large  in- 
dependent factor  entitled  to  its  own  psychology.  It  probably  does 
not  play  as  large  a  part  in  school  work  as  do  the  verbal,  arithmetic, 
and  memory  factors,  but  it  may  play  even  a  greater  part  than  these 
three  in  adult  activity  represented  by  trades  and  engineering.  It 
should  certainly  be  studied  in  these  connections. 

The  speed  factor  seems  to  be  genuine  enough  in  connection 
with  those  things,  reading  and  arithmetic,  in  which  it  has  prob- 
ably been  emphasized.  To  determine  its  significance  in  the  vari- 
ous adult  walks  of  life  calls  for  careful  study. 

Bearing  in  mind  that  the  smaller  third-grade  population,  for 
which  scores  on  ten  tests  are  available,  is  a  select  population  and 
one  chosen  in  a  manner  which  is  difficult  of  precise  definition,  we 
may  nevertheless  find  it  suggestive  to  note  the  factor  values  found 
in  the  case  of  this  group.  Tables  XXIX,  XXX,  XXXI,  and 
XXXII  are  for  this  population  similar  to  tables  already  given  for 
the  preceding  populations. 
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TABLE  XXX 

Based  upon  the  Strength  of  Special  Bonds  between  Variables  of 
the  Third-Grade  Population  of  60 

Note. — If  there  were  no  special  bonds  the  number  of  positive  tetrads  per  each 
pair  of  variables  would  be  28.  Numbers  in  parentheses  indicate  number  of  positive 
tetrads  of  value  zero  to  first  two  decimal  places. 


Variables  in 
Pairs 


Number  of 
Positive 
Tetrads 


1,2 28+17(1) 

1,3 28+20  (1) 

1,4 28+11  (2) 

1,5 28—  8(1) 

1,  6 28—13  (1) 

1,7 28+  1  (2) 

1,  8 28—28 

1,9 28—  8  (2) 

1,10 28+  8(3) 

2,3 28+  5(2) 

2,  4 ;28+  0 

2,5 28+10  (1) 

2,6 !28—  6(2) 


2,7.. 
2,8.. 
2,9.. 
2,10. 
3,4.. 
3,5.. 
3,6.. 
3,7.. 
3,8.. 
3,9.. 


28—  6  (2) 
28—20 
28—  3  (2) 
28+  3  (1) 
28+  7  (3) 
28—  6  (3) 
28+10 
28—17  (2) 
28+  1  (2) 
28—18  (2) 


Sum  of  All 

the  Positive 

Tetrads 


8.58 

4.72 

3-70 

.88 

.48 

1.49 

.00 

.71 

2.25 

2-51 

2.20 

3.36 

1.46 

.69 

.19 

1.69 

2.01 

2-06 

•  51 

2.23 

.17 

1.03 

.16 


Variables  in 
Pairs 


Number  of 
Positive 
Tetrads 


3,  10 
4,5. 
4,6. 
4,7. 
4,8. 
4,9. 
4,10 
5,6. 
5,7. 
5,8. 
5,9. 

5,  10 
6,7. 
6,8. 
6,9. 

6,  10 
7,8. 
7,9., 
7,10, 
8,9., 

8,  10, 

9,  10, 


28—  2  (2) 
28—  3  (1) 
28+  1  (3) 
28—25  (2) 
28—12 
28+11 
28+10  (2) 
28+17 
28+  9  (2) 
28+  5  (1) 
28—  8  (2) 
28—17  (5) 
28+16 
28+11  (2) 
28—  9  (1) 
28—27  (1) 
28+22  (1) 
28+  5  (3) 
28—  5 
28+10  (5) 
28+11  (2) 
28+20 


Sum  of  All 

the  Positive 

Tetrads 


.93 

1.05 

1.37 

.03 

.36 

3-56 

1.89 

7.64 

3.85 

2.76 

1.34 

.08 

5-01 

3-10 

.69 

.00 

6.97 

1.98 

.83 

2-22 

2.00 

8.49 


From  a  study  of  Table  XXX  it  is  apparent  that  the  process 
of  selection  of  the  sixty  pupils  has  introduced  a  very  great  com- 
munity of  function  between  Tests  9  and  10.  Whether  this  inti- 
macy is  one  of  manipulation  of  spatial  relationships  or  of 
understanding-  directions  or  of  something  else  we  cannot  say.  It 
is,  however,  clear  that  a  very  substantial  factor  additional  to  the 
a,  (5,  y,  5,  g,  Z,  factors  of  the  population  of  110  third-grade  children 
is  required.  Such  a  factor  called  #  (Spatial  2)  has  been  introduced 
into  the  preliminary  estimates  of  Table  XXXI.    Because  of  the 
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Preliminary  Estimates 
tion  of  60 


TABLE  XXXI 

of  the  Factors  Entering  into  the  Popula- 
Third-Grade  School  Children 


Tests 

Maturity, 
Heteroge- 
neity, etc. 
a 

Verbal 
0 

Number 
7 

Memory 
5 

Spatial  1 

e 

Speed 
t 

Spatial  2 

e 

Reading — 
1.  Speed 

•  35 

•  62 

.49 

2.  Power 

.62 

.75 

.15 

Arithmetic — 

.36 

.37 

.66 

4.  Power 

.43 

•  20 

•  71 

.14 

Memory — 
5.  Words 

.69 

.12 

.50 

.11 

6.  Numbers    . . 

•  54 

•  14 

.62 

.18 

7.  Meaningful 
symbols  . . . 

.52 

•  30 

.33 

8.  Meaningless 
symbols  .... 

.55 

—.32 

.59 

Space — 
9.  Power  .... 

.60 

.23 

.16 

•  50 

10.  Speed 

.40 

.20 

.40 

.50 

uncertain  nature  of  this  factor,  the  8  factor,  called  spatial  in  the 
population  of  110,  is  here  designated  "Spatial  1."  From  a  study 
of  the  tests  it  would  seem  that  Spatial  1  involves  a  sensing  and 
retention  of  geometric  forms,  whereas  Spatial  2  involves  their 
manipulation.  The  final  factor  values  as  given  in  Table  XXXII 
show  much  consistency,  except  for  the  factors  of  Tests  8  and  9, 
with  the  factor  values  for  the  larger  third-grade  population.  On  the 
whole  these  data  add  but  little  to  those  from  the  larger  and  less 
select  third-grade  population.  Where  the  results  of  Table  XXXII 
are  not  in  harmony  with  those  of  Table  XXVII  the  difference  is 
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TABLE  XXXII 
Final  Factor  Values  for  Third  Grade— N=60 


Note. — Close   o 
decimal  place  about 

f    forty-fifth    successive    approximation. 

.005. 

Calculation    error 

in    third 

Variables 

Maturity, 
Heteroge- 
neity 
a 

Verbal 
0 

Arith- 
metic 
y 

Memory 
5 

Spatial  1 

t 

Speed 

Spatial  2 

e 

Reading — 

.374 

.661 

.133 

.443 

2.  Power 

.614 

.700 

.199 

Arithmetic — 

.313 

.251 

.662 

.333 

.254 

.609 

—.107 

.080 

Memory — 
5.  Words      . . . 

•  673 

.122 

.530 

—083 

—  064 

6.  Numbers    . 

.548 

•  233 

.701 

.119 

7.  Meaningful 
symbols  . . . 

•  513 

•283 

.432 

8.  Meaningless 
symbols 

.531 

•  313 

.630 

Space — 
9.  Power 

•  535 

.187 

—.155 

—  131 

.596 

10.  Speed 

.319 

.195 

—.208 

.153 

.703 

probably  due  to  an  error  in  the  former  table,  because  there  is  un- 
doubtedly a  large  systematic  error  due  to  selection  entering  into 
the  factor  values  for  the  population  of  60,  and  there  is  also  a  much 
larger  chance  error  in  the  data  than  in  the  data  for  the  population 
of  110. 


CHAPTER  VII 

THE  FACTORS  FOUND  IN  THE  KINDERGARTEN 
POPULATION 

The  data  herein  utilized  were  collected  and  basic  correlation 
and  tetrad  difference  calculations  made  by  Miss  Guinevere  Kotter 
(1926).  They  are  reported  in  much  greater  detail  in  her  master's 
thesis,  "Mental  Peculiarities  of  Kindergarten  Children,"  on  file  in 
the  Stanford  University  Library. 

After  having  found  that  the  independent  mental  traits  were 
much  the  same  for  seventh-grade  as  for  third-grade  children,  it 
seemed  very  desirable  to  examine  still  younger  children,  with  a 
view  to  discovering  if  the  same  traits  were  present  and  inde- 
pendent at  the  younger  age.  The  tests  used  for  the  third-  and 
seventh-grade  children  were  too  difficult  for  the  kindergarten  chil- 
dren. So  a  number  of  very  simple  individual  tests  were  devised. 
It  was  not  feasible  in  the  time  available  to  attempt  to  devise  tests 
which  would  parallel  all  of  the  tests  given  to  the  older  children, 
but  certain  of  these  were  quite  closely  paralleled,  as  is  obvious  from 
the  following  description  of  the  tests. 

Test  1,  Memory  for  Meaningful  Forms 

1.  circle  5.  quarter-moon  or  crescent 

2.  square  6.  heart 

3.  oblong  7.  triangle 

4.  cross 

A  row  of  meaningful  forms  was  shown  and  certain  of  them  were 
touched  by  the  experimenter  in  a  standardized  order.  The  row 
was  then  covered  while  at  the  same  time  a  second  row  of  forms 
was  exposed.  The  child  was  called  upon  to  point,  in  the  proper 
order,  to  the  forms  in  this  second  series  which  had  been  touched 
by  the  experimenter  in  the  first  row. 

Test  2,  Control  of  Meaningful  Visual  Memory  Images 

The  same  material  was  used  as  in  Test  1  ;  but  here  the  child 
was  given  an  opportunity  to  examine  briefly  the  forms  of  the  first 
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row,  and  then  the  experimenter,  instead  of  touching-  certain  forms, 
removed  certain  ones  while  the  child's  eyes  were  covered.  The 
child  then  looked  at  the  remaining  forms  in  the  first  row  for  a 
brief  period.  This  row  was  then  covered  at  the  same  time  that 
the  second  row  was  exposed,  and  the  child  called  upon  to  point 
to  the  forms  which  had  been  removed.  There  is  thus  a  demand  upon 
the  subject  that  he  not  only  secure  an  image  of  forms  presented, 
but  he  must  operate  upon  certain  of  the  images,  i.e.,  he  must  deduct 
from  his  concept  those  images,  the  causal  forms  of  which  still  lie 
before  him  when  his  eyes  are  uncovered,  and  he  must  remember 
the  forms  which  have  been  removed  long  enough  to  pick  them  out 
when  the  second  row  is  presented.  This  task  surely  involves  more 
than  memory,  and  is  referred  to  as  a  test  of  one's  Control  of  Mean- 
ingful Visual  Memory  Images. 

Test  3,  Memory  for  Meaningless  Forms 

The  same  technique  was  here  used  as  in  the  case  of  Test  1. 
The  meaningless  forms  used  were  selected  from  specimens  found 
in  the  third-  and  seventh-grade  tests  for  memory  of  meaningless 
forms. 

Test  4,  Control  of  Meaningless  Visual  Memory  Images 

The  material  of  Test  3  and  the  technique  of  Test  2  were  em- 
ployed in  this  test. 

Test  5A,  Memory  for  Meaningful  Verbal  Material 

1.  time  6.  bring,  in,  get 

2.  may,  arm  7.  give,  but,  near,  few 

3.  was,  has  8.  stop,  on,  fall,  cold 

4.  care,  some,  run  9.  true,  go,  came,  spring 

5.  next,  is,  word  10.  his,  yet,  why,  late,  come 

Each  series  was  given  to  the  child  orally  with  the  instruction  that 
he  repeat  it  immediately  afterward. 
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Test  5B,  Memory  for  Meaningless  Verbal  Material 

1.  bem  6.  tek,  zen,  hap 

2.  mif,  het  7.  var,  pip,  dop 

3.  nid,  rul  8.  rof,  kul,  tep,  rel 

4.  tul,  kek  9.  mup,  hif,  lum,  laz 

5.  pirn,  sul,  riz  10.  rim,  nud,  pob,  sep,  meb 

The  administration  of  this  test  was  similar  to  that  of  Test  5A. 

Test  6,  Divided  Forms  Test 

1.  circle  5.  cross 

2.  heart  6.  quarter-moon  or  crescent 

3.  oblong  7.  triangle 

4.  square 

The  subject  was  shown  a  perfect  form  for  five  seconds  and  asked 
to  "find  two  pieces  that  when  put  together  will  make  this  for  us." 

Test  7,  Knox  Cube  Test 
This  test  was  given  as  standardized  by  Knox. 

Tests  5A  and  5B  were  divided  with  the  intention  of  keeping 
them  distinct  in  order  to  provide  evidence  as  to  a  verbal  bond,  but 
the  correlation  for  these  two  when  corrected  for  attenuation  was 
found  to  be  1.03  (P.E.  =  .034),  thus  indicating  that  the  two  tests 
measured  the  same  function.  This  high  correlation  alone  gives  evi- 
dence of  a  verbal  factor,  and,  most  surprising,  it  locates  the  factor 
as  something  that  is  independent  of  meaning,  for  the  meaningless 
words  measure  the  selfsame  function  as  do  the  meaningful  words. 

Certainly  if  when  this  verbal  factor  first  appears  in  the  kin- 
dergarten it  is  independent  of  "meaning,"  the  thing  which  nurture 
has  added,  it  is  altogether  reasonable  to  attribute  this  bond  to 
original  nature. 

Because  of  this  high  correlation  between  Tests  5A  and  5B, 
they  were  combined  into  a  single  Test  5,  Memory  for  Verbal  Ma- 
terial.  Their  combination  at  this  stage  of  the  study  precludes  the 
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later  re-establishment  of  a  verbal  factor  unless  such  a  factor  is 
already  present  in  one  or  more  of  Tests  1,  2,  3,  4,  6,  7.  From 
the  nature  of  these  tests  this  does  not  seem  very  probable.  The 
further  study  of  the  correlations  should  give  us  evidence  as  to 
memory  and  spatial  relationship  factors.  The  presumable  presence 
of  a  memory  factor  in  at  least  six  (Tests  1,  2,  3,  4,  5,  7)  of  the 
seven  tests  mitigates  against  its  clear-cut  discovery,  for  it  almost 
partakes  of  the  nature  of  a  general  factor  for  this  group  of  tests. 
Originally,  three  tests  involving  numbers  were  planned,  but 
the  time  demands  when  giving  individual  tests  are  so  great  that  it 
was  necessary  to  omit  these.  We  thus  have  no  means  of  discov- 
ering the  presence  of  a  number  factor.  We  also  have  no  means  of 
discovering  a  speed  factor  or  an  ebullience  factor.  Table  XXXIII 
following  and  Table  XXXIV  (page  146)  give  the  basic  data. 


TABLE  XXXIII 

Means,   Standard   Deviations,   and   Correlations   for   107   Kinder- 
garten Children  of  Ages  3  Years  6  Months 
to  6  Years  3  Months 

Note. — Figures  above  the  upper-left  to  lower-right  diagonal  are  correlation  coefficients 
corrected  for  attenuation;  figures  along  this  diagonal  are  reliability  coefficients;  figures 
below  it  are  raw  correlation  coefficients. 


1 

2 

3 

4 

5 

6 

7 

1.75 

7.00 

1.65 
6.98 

1.88 
7.11 

1.80 
7.12 

2.68 
9.84 

2.03 

7.21 

2.15 

M    .          

6.46 

1.   Memory  for  Meaningful  Forms 

.6850 

.8826 

.6603 

77.61 

.5814 

.6543 

.9663 

2.   Control  of  Meaningful  Verbal 

.5490 

.5650 

.8802 

.5755 

.4934 

.6706 

.8295 

3.   Memory        for        Meaningless 

.4678 

.5666 

.7330 

.7276 

.5265 

.8573 

.8517 

4.   Control  of  Meaningless  Visual 

.4974 

.3351 

.4825 

.6000 

.3657 

.4951 

.7603 

5.   Memory  for  Verbal  Material.. 

.4499 

.3469 

.4215 

.2649 

.8740 

.2924 

.6939 

.4427 

.4123 

.6003 

.3136 

.2236 

.6690 

.7013 

.5741 

.4478 

.5237 

.4229 

.4660 

.4118 

.5160 
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Table  XXXIV  indicates  a  number  of  bonds.  We  can  better 
judge  just  how  many  if  we  first  calculate  at  least  one  standard 
error  of  a  mean  tetrad.  For  example  there  are  eleven  tetrads 
indicating  a  positive  xlxz  bond.  This  is  one  more  than  chance 
would  yield.  The  mean  of  all  the  twenty  tetrads  is  .02,  which  is  .02 
more  than  chance  would  yield.  Is  this  departure  from  chance  sig- 
nificant? The  standard  error  of  this  mean  tetrad  is  .032.  As  the 
mean  tetrad  is  only  two-thirds  its  standard  error,  we  do  not  feel 
called  upon  to  explain  an  x1xs  bond. 

Let  us  now  examine  the  mean  x^\\  tetrad.  Its  value  is  —.09, 
and  its  standard  error  is  .042,  so  that  the  mean  tetrad  is  over  twice 
its  standard  error.  We  must  therefore  consider  that  there  is  a  real 
negative  bond  of  some  sort  between  the  two  variables  xx  and  x3. 

Preliminary  estimates  of  factor  values  were  made  and  cor- 
rected by  successive  approximations,  resulting  in  Table  XXXV. 
The  procedure  was  the  same  as  that  employed  with  earlier  popula- 
tions except  that  in  this  case  all  the  reliability  coefficients  were 
used.  Each  was  multiplied  by  .95,  and  the  endeavor  was  then 
made  to  secure  factor  values  that  would  account  for  all  the  inter- 
correlations  and  these  reduced  reliability  functions.  The  adequacy 
with  which  the  factor  values  of  Table  XXXV  account  for  the 
obtained  inter-correlations  and  reliability  coefficients  is  decidedly 
great. 

The  general  maturity  and  heterogeneity  factor  is  greater  than 
in  the  case  of  the  third-  and  seventh-grade  groups.  This  is  as  one 
would  expect  since  the  primary  group  includes  a  wide  age  range, 
especially  when  expressed  as  a  percentage  of  the  mean  age,  and 
such  percentage  expression  is  probably  fairly  reasonable  when 
dealing  with  the  maturity  of  young  children.  Further,  the  mem- 
bers of  the  group  have  been  in  school  so  short  a  time  that  they 
have  not  as  yet  been  sorted  out  on  the  basis  of  ability.  At  this 
level  such  a  sorting  would  largely  be  on  the  ground  of  maturity 
and  of  racial  differences. 

As  anticipated,  a  factor  which  we  may  call  the  verbal  factor  is 
very  large  in  Test  5,  Memory  for  Verbal  Material,  and  scarcely 
present  in  any  of  the  other  tests. 
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A  factor  which  we  may  surely  designate  as  a  memory  factor 
is  large  in  Tests  5,  Memory  for  Verbal  Material,  and  7,  Knox 
Cube  Imitation  Test,  and  is  not  negligible  in  Test  3,  Memory  for 
Meaningless  Forms,  or  in  Test  1,  Memory  for  Meaningful  Forms. 


TABLE  XXXV 

Final   Factor   Values   for   the   Population   of    107   Kindergarten 
Children  at  Close  of  48th  Successive  Approximation 


Tests  Used 

Maturity, 
Heteroge- 
neity, etc. 
a 

Verbal 
/3 

Memory 

5 

Spatial 
No.  1 

e 

Spatial 
No.  2 

6 

Control 
of  Mean- 
ingless 
Content? 
V 

1.  Memory  for  Mean- 
ingful Forms 

2.  Control  of  Meaning- 
ful  Visual   Memory 
Images 

.79 

•  71 
.62 

•  63 

.49 

.52 
.62 

.61 

.13 

.18 

•  50 
.36 

.27 
.27 

.50 

.15 

.58 
.13 

18 

3.  Memory  for  Mean- 
ingless Forms 

4.  Control  of  Meaning- 
less Visual  Memory 
Images 

.42 

5.  Memory  for  Verbal 
Material    

6.  Divided  Forms  Test 

7.  Knox  Cube  Test 

—  .24 

Test  3,  Memory  for  Meaningless  Forms,  and  Test  6,  Divided 
Forms  Test,  have  a  large  common  factor  which  it  is  reasonable  to 
designate  as  spatial.  Traces  of  this  same  factor  are  found  in 
Test  4,  Control  of  Meaningless  Visual  Memory  Images,  and 
Test  7,  Knox  Cube  Test. 

There  is  a  small  factor  entering  into  Tests  2  and  3,  which  like- 
wise must  be  spatial.  The  existence  of  such  a  factor  was  entirely 
unanticipated,  but  a  study  of  Spatial  1  and  Spatial  2  of  the  third- 
grade  population  immediately  suggests  that  this  x2x3  factor  is 
what  was  earlier  called  Spatial  1  (sensing  and  retention  of  geomet- 
ric forms),  while  the  larger  factor  found  in  Tests  3  and  6  and  to 
a  small  extent  in  Tests  4  and  7  is  what  was  called  Spatial  2  (ma- 


FACTORS  IN  THE  KINDERGARTEN  149 

nipulation  of  spatial  relationships).  The  factor  values  for  this 
kindergarten  population  were  determined  by  the  writer  and  his 
assistants  without  knowledge  of  what  the  variables  stood  for,  and 
it  was  both  surprising  and  assuring  when  the  variables  were 
finally  labeled  to  see  how  beautifully  the  factors  conformed  to 
those  already  discovered  in  the  third-  and  seventh-grade  popula- 
tions. There  is  but  a  single  factor  found  here  not  foreshadowed 
by  the  earlier  work. 

There  is  a  large  factor  in  Test  4,  Control  of  Meaningless  Visual 
Memory  Images,  which  is  in  the  main  specific  to  this  test.  Indi- 
cations of  the  same  factor,  though  in  a  negative  sense,  are  found 
in  Test  2,  Control  of  Meaningful  Visual  Memory  Images,  and 
Test  6,  Divided  Forms  Test.  Tentatively,  this  factor  is  referred 
to  as  a  "Control  of  Meaningless  Content"  factor,  but  not  having 
evidence  of  a  similar  factor  in  the  third-  and  seventh-grade 
populations,  the  fitness  of  this  designation  is  very  much  open  to 
question. 

In  brief,  all  the  factors  except  this  last  one  seem  to  be  of  the 
same  nature  as  factors  revealed  by  the  older  populations.  That 
the  following  traits,  (1)  facility  with  verbal  material,  (2)  manipu- 
lation of  spatial  relationships,  (3)  memory,  are  independent  cate- 
gories of  mental  life  from  a  very  early  age  (probably  from  birth) 
seems  hardly  open  to  question.  The  sensing  and  retention  of 
geometric  forms  should  probably  also  be  included  in  this  list,  also 
a  number  factor,  because  of  its  indubitable  presence  in  the  third- 
and  seventh-grade  populations,  for  it  should  be  recalled  that  no 
test  for  this  factor  was  made  in  the  case  of  the  kindergarten  group. 


CHAPTER  VIII 

DESCRIPTION,  SCORING,  AND  RELIABILITY  OF 

TESTS  USED 

Samples  of  all  new  tests  used  are  provided  below.  The  test 
designated  "Reading  Exercises"  is  the  Reading  Speed  test,  Test  1 
(pages  166-68,  180-81).  The  Stanford  Paragraph  Meaning  Test 
is  the  Reading  Power  test,  Test  2  (for  description  of  this  and  of 
Arithmetic  Power,  see  Stanford  Achievement  Tests,  World  Book 
Company,  1926).  The  test  designated  "Arithmetic  Exercises"  is 
the  Arithmetic  Speed  test,  Test  3  (pages  169-70,  182-83)  ;  and 
the  Stanford  Arithmetic  Reasoning  Test  is  the  Arithmetic  Power 
test,  Test  4.  The  test  designated  "Circles  Test"  has  four  types  of 
material  (pages  174—77,  186-89) :  that  part  comprising  verbal 
material  is  the  Memory  Verbal  test,  Test  5 ;  that  part  comprising 
numbers  is  the  Memory  Numbers  test,  Test  6 ;  that  part  comprising 
meaningful  symbols  is  the  Memory  for  Meaningful  Symbols  test, 
Test  7 ;  and  that  part  comprising  meaningless  symbols  is  the  Mem- 
ory for  Meaningless  Symbols  test,  Test  8.  The  one-page  test 
which  is  designated  "Figure  Exercise  No.  2"  (pages  178-79,  190) 
is  the  Manipulation  of  Spatial  Relationships  Power  test,  Test  9. 
And  the  two-page  test  designated  "Figure  Exercise  No.  1"  (pages 
171-73,  184—85)  is  the  Manipulation  of  Spatial  Relationship  Speed 
test,  Test  10. 

The  directions  as  here  given  (taken,  when  shown  in  smaller 
type,  from  stenographic  report  of  examiner's  words)  were  rather 
closely  followed  in  both  the  third  and  the  seventh  grades,  except 
that  in  the  third  grade  about  twice  as  much  foretest  and  prelimi- 
nary training  was  given  in  the  case  of  the  figure  exercises  and  a 
more  mature  mode  of  expression  was  at  times  used  in  the  seventh 
grade  than  in  the  third  grade.  Some  abridgment  of  these  instruc- 
tions was  made  the  second  day  when  Form  B  of  the  tests  was 
given.  Judging  by  the  test  results  there  was  no  case  in  which  a 
child  understood  the  directions  on  the  first  day  and  failed  to  under- 
stand them  on  the  second. 
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All  but  one  of  the  tests  are  well  adapted  to  the  seventh-grade 
level  of  ability,  the  exception  being  Test  10,  which  was  only  fairly 
satisfactory  in  this  grade.  All  but  the  speed  and  power  tests  in 
spatial  manipulation  are  well  adapted  to  the  third-grade  level.  In 
the  third  grade  these  two  should  have  been  preceded  by  fore- 
exercises  more  detailed  than  those  actually  given.  For  observations 
as  to  the  nature  of  Tests  11,  12,  and  13,  see  chapter  v,  page  112. 

FORM  A 

Speed  of  Reading  Test  (Test  1). — Following  are  directions 
used  in  the  third  grade : 

At  the  top  of  these  sheets,  where  it  says  "name,"  write  your  name. 
Use  blue  pencils.  Right  below  where  it  says  "Name,"  it  says  "Age." 
Write  the  number  that  tells  how  old  you  are  now.  Right  next  to  that 
it  says,  "When  is  your  next  birthday?"  Write  it  down  if  you  know  it. 
If  you  don't  know  it,  you  will  have  to  leave  that  blank.  Under  that  it 
says,  "How  old  will  you  be  then?"  Write  the  number  that  tells  how 
old  you  will  be  on  your  next  birthday.  On  the  top  line  it  says  "Boy 
or  girl."  Write  down  which  you  are.  Next  to  that  it  says  "Date." 
What  date  is  it  today?  [Give  date.]  Write  down  [date].  Under  that 
it  says  "School."  [Give  name  of  school.]  Write  down  [name  of 
school].  Some  of  you  are  in  the  low  third  and  some  of  you  are  in  the 
high  third.  All  of  those  in  the  low  third  write  down  "L  3"  [illustrate 
on  blackboard].   All  of  those  in  the  high  third  write  down  "H  3." 

On  the  first  page  there  is  a  little  story,  "When  the  Train  Passes." 
[Read  directions  on  page  1,  Form  A.]  A  parenthesis  looks  like  this 
[illustrate  on  blackboard].  Ready,  go.  Use  blue  pencils.  [Pupils  were 
provided  with  pencils  having  blue  lead  at  one  end  and  red  at  the  other. 
By  changing  colors  it  was  possible  to  score  the  test  for  different  time 
limits.]  [After  five  minutes]  Stop.  Now  turn  your  pencils  around  and 
go  right  on.  [Assistant  must  see  that  red  lead  is  being  used.]  [After 
four  minutes]  Stop. 

The  five-minute  score  was  used  in  preference  to  the  nine- 
minute  score  because  the  nature  of  the  material  seemed  to  indicate 
that  the  latter  was  more  of  a  "power"  score  for  these  third-grade 
children — the  more  speedy  of  them  having  finished  the  first  story 
and  got  well  into  the  second  one.  It  was  determined  by  the  method 
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explained  in  chapter  iii,  page  94,  that  the  optimum  scoring  scheme 
was  (A  —  .8  E)  for  Form  A,  and  {A  —  1.3  E)  for  Form  B,  in 
which  A  is  the  number  of  parentheses  attempted  and  E  the  number 
incorrectly  marked.  The  scoring  scheme  which  was  actually  used 
was  {A  —  E)  or  the  number  of  parentheses  correctly  marked  in 
five  minutes. 

The  reliability  of  the  scores  thus  obtained  is  .878  for  the  popu- 
lation of  110  and  .850  for  the  population  of  60.  As  the  actual 
score  used  is  the  sum  of  the  scores  on  the  two  forms,  these  relia- 
bilities were  stepped  up  by  the  Spearman-Brown  formula,  giving 
the  reliabilities  of  Tables  XXIII  and  XXIX. 

The  time  limits  of  the  scoring  scheme  for  this  test  were  the 
same  in  the  seventh  grade  as  in  the  third  grade.  Although  the 
optimum  scoring  scheme  was  (A  —  1.2  E)  for  Form  A,  and 
(A  —  1.4  E)  for  Form  B,  these  were  not  sufficiently  better  scoring 
schemes  over  (A  —  E)  to  justify  using  them.  The  reliability  of 
the  single  form  for  the  population  of  140  is  .851,  and  for  the 
population  of  109  it  is  .850.  These  stepped  up  give  the  reliabilities 
of  Tables  X  and  XVI. 

Reading  Power  Test  (Test  2). — In  both  the  third  and  seventh 
grades  the  score  is  the  sum  of  the  scores  on  the  three  parts — para- 
graph meaning,  sentence  meaning,  and  word  meaning — of  the 
Stanford  Achievement  Test,  which  was  given  and  scored  as 
described  in  the  1926  Manual  of  Directions.  Form  A,  Primary 
Examination,  was  used  in  the  third  grade,  and  Form  A,  Advanced 
Examination,  in  the  seventh  grade.  The  reliability  for  the  third 
grade  was  obtained  by  splitting  the  test  (all  three  parts),  corre- 
lating their  odds  against  the  evens.  In  the  paragraph  meaning  test, 
one  paragraph,  and  not  one  blank,  was  considered  an  element  when 
splitting  into  halves.  These  half -scores  were  correlated  and  then 
stepped  up  by  the  Spearman-Brown  formula  to  obtain  the  reliabili- 
ties given  in  Tables  XXIII  and  XXIX.  In  the  seventh  grade  the 
reliabilities  for  the  140  and  109  populations  were  estimated  from 
reliability  data  at  hand  covering  a  large  normal  population  of 
fourteen-year-olds  (see  Kelley,  1926,  Influence).  The  means  for 
the  normal  population  of  fourteen-year-olds  and  for  the  present 
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population  of  140  seventh-grade  children  were  224  and  195,  re- 
spectively. This  is  sufficiently  close  to  warrant  the  assumption  of 
an  equal-standard  error  of  estimate  in  the  two  cases.  Making  this 
assumption  and  using-  the  formula  connecting  reliability  with  range 
examined  (Formula  178  of  Kelley,  1924,  Statistical),  yields  the 
reliabilities  of  Tables  X  and  XVI. 

Arithmetic  Speed  Test  (Test  3). — The  directions  for  this  test 
were  as  follows : 

Turn  your  books  to  the  back  page,  page  8.  [See  page  173.]  It  says 
at  the  top  "Computation  Exercises."  [Read  directions  aloud.]  Turn  to 
pages  4  and  5.  Work  the  problems  in  order.  Work  as  fast  as  you  can, 
drawing  a  line  under  the  right  answer.  If  there  is  any  one  that  you 
cannot  do,  leave  it  and  go  on  to  the  ones  after  it.  Work  with  your  blue 
pencils. 

Various  working  times  were  examined  by  the  device  of  having 
the  pupils  work  with  differently  colored  pencils  during  different 
periods.  The  score  finally  adopted  was  based  upon  six  minutes' 
working  time  in  the  third  and  five  minutes'  working  time  in  the 
seventh  grade.  The  optimum  scoring  scheme  for  the  third  grade 
was  found  to  be  (S  —  1.48  E),  in  which  S  is  the  number  of  prob- 
lems attempted  and  E  the  number  of  errors.  With  this  score  the 
reliability  is  .692.  The  scoring  scheme  actually  used  is  (S  —  E)  or 
the  number  of  problems  correctly  worked  in  six  minutes.  This  has 
a  reliability  of  .678  on  the  same  population  (Ar  =  122),  giving  the 
reliability  of  .692  for  the  optimum  scoring  method.  For  the  popu- 
lation of  110  the  reliability  is  .667,  and  for  the  population  of  60  it 
is  .698.  These  last  two  were  stepped  up  by  the  Spearman-Brown 
formula  to  give  the  reliabilities  of  Tables  XXIII  and  XXIX. 

The  time  limit  for  the  seventh  grade  is  five  minutes.  The  opti- 
mum scoring  scheme  is  {S  —  1.41  E).  The  scheme  actually  used 
is  (S  —  E),  which  has  a  reliability  for  the  population  of  140  of 
.832,  and  for  the  population  of  109  of  .851.  These  were  stepped  up 
giving  the  reliabilities  of  Tables  X  and  XVI. 

Arithmetic  Power  Test  (Test  4). — The  test  used  to  measure 
computation  power  was  the  Stanford  Computation  Test.    It  was 
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given  and  scored  as  directed  in  the  1926  Manual  of  Directions. 
The  reliabilities  were  determined  by  interpolation  in  a  table  of 
standard  errors  of  individual  scores  not  as  yet  published.  It  may 
be  looked  for  in  the  next  edition  of  the  Stanford  Achievement 
Test  Manual.  The  reliabilities  given  in  Tables  XXIII,  XXIX,  X, 
and  XVI  are  those  for  a  single  form  of  the  test,  which  is  what 
was  used  in  measuring  these  pupils. 

Memory  tests:  Test  5  for  Verbal  Material;  Test  6  for  Numeri- 
cal Material;  Test  7  for  Meaningful  Symbols;  and  Test  8  for 
Meaningless  Symbols.  The  directions  for  the  seventh  grade  were 
as  follows : 

Write  your  name,  sex,  age  at  last  birthday,  date,  grade  that  you  are 
in,  and  the  name  of  your  school,  in  the  spaces  provided.  Today  is  the 
[give  date]  and  you  are  in  the  [give  grade],  and  of  course  this  school 
is  the  [give  name  of  school]. 

Now  look  at  the  squares  in  which  are  words,  numbers,  and  symbols, 
beside  each  of  which  is  a  little  star.  I  am  going  to  ask  you  to  draw  lines 
connecting  certain  of  these  stars.  Look  at  this  card  [point  to  the  words 
"of,"  "to,"  "on,"  appearing  on  the  face  of  Card  No.  2]  and  fix  these 
words  in  mind,  so  as  to  remember  them  [after  ten  seconds  turn  card 
over,  exposing  the  number  2  on  the  back] .  Now,  find  a  square  with  the 
number  2  right  in  the  middle  of  it,  and  as  soon  as  you  have  found  it, 
draw  a  line  connecting  the  stars  which  are  right  by  the  side  of  the 
three  words  which  you  have  just  seen.  Draw  the  line  right  now  [allow 
ten  seconds].  If  you  have  done  it  correctly,  it  will  look  like  this.  [Show 
sample  on  an  18-inch  square  cardboard,  and  have  assistants  walk  about 
the  room  to  discover  any  who  have  it  wrong.  If  any  seem  perplexed, 
do  this  over,  explaining  and  watching  those  having  difficulty.]  Now, 
let  us  do  another  one.  Watch  carefully  [show  Card  No.  11  for  eight 
seconds,  and  then  show  the  reverse,  giving  the  number  of  the  card]. 
This  is  Card  No.  11,  so  find  Square  No.  11  and  connect  in  the  proper 
way  the  three  numbers  which  you  have  seen  [allow  ten  seconds].  If 
you  have  done  it  correctly,  it  will  look  like  this  [show  sample].  A  line 
from  3  to  5  to  6  would  be  incorrect  [pointing],  as  the  proper  order  is 
3,  6,  5.  How  many  have  it  drawn  exactly  like  this  [pointing  to  sample]  ? 
Raise  your  hands  [assistant  to  discover  if  anyone  has  it  wrong  and  to 
explain  the  procedure  to  him  individually]. 

Let  us  try  one  more.   Watch  carefully  [expose  Card  No.  8  for  six 
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seconds  and  then  show  the  reverse].  Find  Square  No.  8  and  draw  the 
proper  lines  [allow  ten  seconds].  If  you  have  done  it  correctly,  it  will 
look  like  this  [show  sample].  How  many  have  it  exactly  like  this? 
Raise  your  hands  [assistant  to  discover  if  there  still  are  errors.  If  there 
are,  give  Card  No.  4  as  a  practice  card.  If  there  are  no  errors,  skip 
this  and  start  with  the  test  proper,  Card  No.  4,  as  follows].  Now,  I 
am  going  to  show  some  more  cards,  but  from  now  on  I  am  not  going  to 
tell  you  whether  you  are  right  or  not,  so  look  at  the  cards  carefully 
[show  cards  in  order,  exposing  the  front,  the  number  of  seconds  indi- 
cated in  small  print  in  the  corner  on  the  front,  and  allow  writing  time 
one  and  one-half  times  as  long.  Precede  each  flash  by,  "The  next  card." 
When  the  bottom  of  the  page  is  reached,  No.  24,  state]  If  you  forget 
part  of  the  words,  numbers,  or  symbols  shown,  do  not  be  disturbed,  but 
do  the  best  you  can  and  draw  lines  connecting  as  many  as  you  remem- 
ber. Now,  we  will  start  on  the  next  page.  The  next  card  is  this  one 
[continue  as  before  to  the  end  of  the  test,  allowing  a  one-minute  break 
at  the  end  of  the  second  page]. 

The  print  on  the  flash  cards  was  in  lower-case  eight-pica  type, 
and  symbols  were  approximately  eight  picas  in  height.  In  Table 
XXXVI  following,  symbols  are  designated  by  numbers,  No.  1 
being  at  the  top  of  the  designated  square  and  the  numbering  thence 
2,  3  .  .  .  .  ,  8  in  a  clockwise  direction. 

TABLE  XXXVI 
Order  of  Exposure  of  Cards  Used  in  Memory  Tests 

Square  in 
Order  of  Exposure  Which  Draw- 

Presentation  Symbols,  Words,  etc.  Time  in        ing  Is  to 

Seconds        Be  Done 

Form  A 

1   of ,  to,  on      1 

2  3,  6,  5  \ 

3  No.  8,  No.  4  J 

4  is,  so,  my,  at. 

5   he,  an,  in 

6  No.  1,  No.  7.. 

7  No.  5,  No.  7. 

8  if,  am,  or. . . . 

9   2,  9,  4,  3 

10  do,  be,  no,  us. 

11   No.  2,  No.  5.. 


[correctly  marked 
samples  shown] 


10 

2 

10 

11 

8 

8 

6 

4 

5 

1 

6 

16 

4 

7 

5 

3 

6 

13 

6 

5 

6 

17 
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TABLE  XXXVI— Continued 


Order  of 

Presentation 


Symbols,  Words,  etc. 


Square  in 
Exposure  Which  Draw- 
Time  in         ing  Is  to 
Seconds        Be  Done 


12  No.  7,  No.  2 

13  no,  at,  to,  if,  do,  we. 

14  5,  2,  6,  8 

15  .. 

16  .. 

17  .. 

18  .. 

19  .. 

20  .. 


. .  my,  go,  of ,  as,  if 

..  No.  4,  No.  8 

..  6,  4,  2 

..  No.  3,  No.  1 

. .  am,  we,  to,  us,  it 

..  No.  5,  No.  7 

21  No.  2,  No.  6 

22  3,  2,  4,  9,  7 

23  No.  2,  No.  8 

24  it,  up,  no,  we,  be,  am 

[Turn  over  to  page  2] 

25  67,  96  

26  No.  2,  No.  8,  No.  5 

27  No.  7,  No.  5 

28  way,  but,  own 

29  No.  8,  No.  6,  No.  3 

30  73,  97,   85 

31  No.  1,  No.  4.... 

32  No.  3,  No.  8 

33   17,  56,  93,  31 

34 No.  7,  No.  1,  No.  5 

35  got,  did,  him,  out,  she 

36   No.  7,  No.  3,  No.  1 

37   89,  46,  27,  59 

38  No.  7,  No.  4 

39  has,  get,  she,  air 

40  No.  7,  No.  1,  No.  3 

41  No.  2,  No.  7,  No.  4 

42 No.  3,  No.  7,  No.  2 

43  49,  74,  11 

44  No.  5,  No.  3,  No.  8 

45  No.  3,  No.  8,  No.  5 

46  No.  6,  No.  1,  No.  5 

47  its,  pay,  any,  not,  day,  the 

48  No.  1,  No.  4,  No.  6 

49  No.  8,  No.  2,  No.  7 


4 

6 

8 

23 

6 

14 

7 

21 

6 

19 

5 

12 

4 

9 

7 

22 

6 

18 

4 

10 

7 

15 

6 

20 

8 

24 

5 

30 

5 

26 

6 

36 

5 

40 

5 

29 

6 

32 

4 

25 

6 

35 

8 

33 

5 

28 

7 

42 

5 

27 

8 

34 

6 

37 

6 

41 

5 

44 

8 

39 

5 

46 

6 

31 

5 

48 

5 

45 

8 

38 

8 

43 

5 

47 

8 

55 
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TABLE  XXXVI— Continued 


Order  of 
Presentation  Symbols,  Words,  etc. 


50  264,  979,  622 

51   rich,  pass,  wait,  each,  were 

52  No.  1,  No.  7,  No.  4 

53  692,  787  

54  982,  443,  685,  630 

55  No.  4,  No.  8,  No.  6 

56  669,  383  

57  tell,    does,    live 

58  No.  1,  No.  4,  No.  6 

59  late,  hope,  wish,  paid 

60  No.  3,  No.  5,  No.  1 

61   365,  539,  307 

62  No.  2,  No.  4,  No.  1 

63  No.  1,  No.  6,  No.  4 

64  No.  5,  No.  3,  No.  1 

65  No.  2,  No.  6,  No.  3 

66  No.  6,  No.  3,  No.  7 

67  will,  done,  move,  lost,  fine,  want 

68  No.  8,  No.  6,  No.  3 

69  No.  8,  No.  6,  No.  1 

70  No.  1,  No.  4,  No.  8 

71   No.  8,  No.  4,  No.  7 

72  No.  3,  No.  5,  No.  8 

[Turn  over  to  page  4] 

73  other,  along,  begin 

74  No.  3,  No.  6,  No.  2,  No.  4 

75  No.  6,  No.  8,  No.  5 

76  No.  2,  No.  4,  No.  1,  No.  6 

77  No.  3,  No.  7,  No.  2,  No.  6 

78  happy,  often,  about,  visit,  being 

79  No.  8,  No.  3,  No.  5 

80  No.  8,  No.  2,  No.  6,  No.  4 

81   No.  3,  No.  5,  No.  2,  No.  6 

82  No.  2,  No.  5,  No.  8,  No.  4 

83  No.  6,  No.  3,  No.  5 

84  No.  1,  No.  5,  No.  2,  No.  7 

85  ......   No.  6,  No.  1,  No.  3,  No.  8 

86  visit,  about,  heavy,  never 

87  No.  7,  No.  4,  No.  2,  No.  6 


Exposure 
Time  in 
Seconds 

Square  in 
Which  Draw- 
ing Is  to 
Be  Done 

8 

51 

7 

61 

8 

57 

6 

49 

10 

53 

8 

54 

6 

50 

5 

59 

5 

63 

6 

60 

5 

65 

8 

52 

5 

66 

8 

69 

8 

56 

8 

72 

8 

70 

8 

62 

5 

64 

8 

71 

8 

58 

5 

67 

8 

68 

5 

73 

6 

78 

8 

82 

5 

89 

7 

95 

7 

75 

8 

84 

6 

80 

5 

88 

8 

86 

8 

85 

6 

77 

7 

93 

6 

74 

6 

81 
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TABLE  XXXVI— Continued 


Order  of 
Presentation 


Symbols,  Words,  etc. 


Square  in 
Exposure  Which  Draw- 
Time  in         ing  Is  to 
Seconds        Be  Done 


88  No.  7,  No.  5,  No.  3,  No.  8,  No.  4 

89  No.  3,  No.  6,  No.  2,  No.  8 

90  No.  3,  No.  5,  No.  1,  No.  4,  No.  8 

91   No.  3,  No.  1,  No.  4,  No.  2 

92  No.  2,  No.  6,  No.  1,  No.  3 

93   until,  heavy,  never,  about,  cover,  today. 

94  No.  1,  No.  4,  No.  8 

95  No.  3,  No.  5,  No.  2,  No.  7 

96  No.  8,  No.  3,  No.  7,  No.  5 


Form 
1 
2 
3 
4 
5 


9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 


B 


25 
26 
27 


[correctly  marked 
samples  shown] 


as,  we,  on 

7,  9,  6  I 
No.  4,  No.  8  J 

as,  is,  go,  at 

do,  it,  be 

No.  6,  No.  2 

No.  3,  No.  6 

he,  up,   am 

8,  6,  9,  4 

us,  or,  am,  at 

No.  5,  No.  7 

No.  8,  No.  6 

it,  to,  an,  so,  be,  if 

9,  3,  6,  7 

if,  up,  my,  go,  no 

No.  1,  No.  7 

6,   5,  9 

No.  5,  No.  1 

so,  on,  is,  or,  us , 

No.  2,  No.  6 

No.  4,  No.  7 

6,  5,  8,  2,  4 

No.  8,  No.  3 

so,  up,  of,  he,  as,  on 

[Turn  over  to  page  2] 

39,  82  

No.  7,  No.  3,  No.  8 

No.  4,  No.  8 


6 

91 

7 

94 

6 

90 

7 

96 

5 

87 

8 

76 

8 

83 

6 

79 

7 

92 

10 

2 

10 

11 

8 

8 

6 

4 

5 

1 

6 

16 

4 

7 

5 

3 

6 

13 

6 

5 

6 

17 

4 

6 

8 

23 

6 

14 

7 

21 

6 

19 

5 

12 

4 

9 

7 

22 

6 

18 

4 

10 

7 

15 

6 

20 

8 

24 

5 

30 

5 

26 

6 

36 
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TABLE  XXXVI— Continued 


Order  of 
Presentation 


Symbols,  Words,  etc. 


Square  in 
Exposure  Which  Draw- 
Time  in         ing  Is  to 
Seconds        Be  Done 


28  off,  our,  ask 

29  No.  8,  No.  2,  No.  7. 

30  55,  86,  79 

31  No.  6,  No.  2 

32  No.  2,  No.  7 

33   13,  94,  21,  50 

34  No.  2,  No.  7,  No.  4. 


35 
36 


law,  sit,  yet,  too,  and. 
No.  2,  No.  8,  No.  6... 


37 95,  26,  88,  71 . 


38  No.  3,  No.  5 

39  son,  let,  old,  out 

40  No.  4,  No.  8,  No.  3 

41  No.  2,  No.  4,  No.  6 

42  No.  2,  No.  4,  No.  7 

43  12,  32,  64 

44  No.  3,  No.  5,  No.  7 

45  No.  5,  No.  8,  No.  2 

46  No.  2,  No.  7,  No.  5 

47  hot,  may,  ask,  new,  for,  two. 

48  No.  4,  No.  2,  No.  7 

49  No.  5,  No.  1,  No.  3 

50  140,  958,  249 

51  care,  sure,  made,  hold,  keep. . 

52  No.  8,  No.  4,  No.  7 

53  502,  764  

54  818,  873,  735,  521 

55  No.  8,  No.  6,  No.  1 

56  455,  288  

57  read,  call,  mean 

58  No.  6,  No.  3,  No.  7 

59  came,  best,  draw,  soft 

60  No.  8,  No.  2,  No.  4 

61  388,  794,  945 

62  No.  8,  No.  2,  No.  6 

63  No.  8,  No.  2,  No.  7 

64  No.  1,  No.  7,  No.  4 

65  No.  7,  No.  5,  No.  2 

66  No.  2,  No.  7,  No.  4 


5 

40 

5 

29 

6 

32 

4 

25 

6 

35 

8 

33 

5 

28 

7 

42 

5 

27 

8 

34 

6 

37 

6 

41 

5 

44 

8 

39 

5 

46 

6 

31 

5 

48 

5 

45 

8 

38 

8 

43 

5 

47 

8 

55 

8 

51 

7 

61 

8 

57 

6 

49 

10 

53 

8 

54 

6 

50 

5 

59 

5 

63 

6 

60 

5 

65 

8 

52 

5 

66 

8 

69 

8 

56 

8 

72 

8 

70 
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TABLE  XXXVI— Concluded 

Square  in 
Order  of                                                                                                          Exposure  Which  Draw- 
Presentation                                Symbols,  Words,  etc.                                 Time  in  ing  Is  to 

Seconds  Be  Done 

67  love,  take,  have,  then,  help,  true 8  62 

68  No.  2,  No.  6,  No.  4 5  64 

69  No.  7,  No.  5,  No.  8 8  71 

70  No.  2,  No.  6,  No.  4 8  58 

71   No.  4,  No.  7,  No.  1 5  67 

72  No.  3,  No.  7,  No.  5 8  68 

[Turn  over  to  page  4] 

73   early,  again,  money 5  73 

74  No.  6,  No.  3,  No.  1,  No.  4 6  78 

75  No.  2,  No.  6,  No.  3 8  82 

76  No.  7,  No.  1,  No.  6,  No.  4 5  89 

77  No.  8,  No.  2,  No.  7,  No.  1 7  95 

78  carry,  given,  today,  order,  never 7  75 

79  No.  3,  No.  7,  No.  4 8  84 

80  No.  6,  No.  4,  No.  7,  No.  5 6  80 

81   No.  4,  No.  1,  No.  3,  No.  6 5  88 

82  No.  3,  No.  7,  No.  4,  No.  8 8  86 

83  No.  2,  No.  4,  No.  8 8  85 

84  No.  2,  No.  6,  No.  8,  No.  4 6  77 

85  No.  5,  No.  7,  No.  4,  No.  8 7  93 

86  today,  alone,  often,  until 6  74 

87  No.  1,  No.  6,  No.  4,  No.  7 6  81 

88  No.  6,  No.  3,  No.  1,  No.  4,  No.  2 6  91 

89  No.  7,  No.  3,  No.  8,  No.  2 7  94 

90  No.  7,  No.  1,  No.  6,  No.  4,  No.  8 6  90 

91   No.  7,  No.  1,  No.  5,  No.  3 7  96 

92  No.  1,  No.  6,  No.  3,  No.  8 5  87 

93   visit,  story,  being,  money,  often,  after 8  76 

94  No.  7,  No.  2,  No.  4 8  83 

95  No.  3,  No.  7,  No.  5,  No.  2 6  79 

96  No.  6,  No.  2,  No.  7,  No.  4 7  92 


Part  of  the  fourth  page  dealing  with  meaningless  and  meaning- 
ful symbols  proved  too  difficult  for  pupils  of  both  grades  studied. 
The  same  administrative  procedure  was  followed  in  the  third  grade 
as  in  the  seventh,  except  that  none  of  the  difficult  fourth  page  of 
the  test  was  employed. 
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For  each  part,  words,  numbers,  meaningful  symbols,  and  mean- 
ingless symbols,  various  scoring  schemes  were  investigated,  for 
the  population  of  140,  with  a  view  to  determining  the  optimum 
procedure.  No  separate  scoring  scheme  study  was  made  for  these 
four  tests,  or  for  Tests  9  and  10,  for  the  third-grade  group.  The 
scoring  devices  actually  adopted  are  the  same  for  both  the  third 
and  seventh  grades,  and  differ  slightly  from  the  statistically  de- 
termined optima  for  the  seventh-grade  population.  US  equals  the 
number  of  squares  (word  squares  in  the  verbal  memory  test, 
number  squares  in  the  number  memory  test,  etc.)  correctly  marked 
in  every  respect,  and  L  equals  the  number  of  lines  correctly  drawn 
(i.e.,  if  two  only  out  of  three  lines  for  a  given  square  are  correctly 
drawn,  a  credit  of  two  is  given,  etc.)  the  general  scoring  scheme 
investigated  may  be  represented  by  (S  +  cL).  In  all  cases  c  proved 
either  so  small  or  so  large  that  it  was  not  necessary  to  use  both 
5"  and  L  in  the  final  scoring  device.  The  scores  actually  used  are 
given  for  each  of  the  four  tests  in  the  following  paragraphs : 

Memory  for  Words. — The  score  is  L,  or  the  number  of  cor- 
rectly drawn  lines.  This  score  has  a  reliability  for  the  140  popula- 
tion of  .802  (the  optimum  correlation  based  upon  6"  —  4.9  L  was 
.803,  which  is  negligibly  higher  than  .802),  for  the  109  population 
of  .756,  for  the  110  population  of  .740,  and  for  the  60  population 
of  .732. 

Memory  for  Numbers. — The  score  is  S,  or  the  number  of 
squares  marked  correctly  in  every  respect.  This  has  a  reliability 
for  the  140  population  of  .457  (the  optimum  is  .462),  for  the  109 
population  of  .444,  for  the  110  population  of  .556,  and  for  the  60 
population  of  .537. 

Memory  for  Meaningful  Symbols. — The  score  is  L,  or  the 
number  of  correctly  drawn  lines.  This  has  a  reliability  for  the  140 
population  of  .7417  (the  optimum  is  .7423),  for  the  109  population 
of  .729,  for  the  110  population  of  .542,  and  for  the  60  population 
of  .404. 

Memory  for  Meaningless  Symbols. — The  score  is  L,  or  the 
number  of  correctly  drawn  lines.   This  has  a  reliability  for  the  140 
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population  of  .708  (the  optimum  is  .712),  for  the  109  population 
of  .731,  for  the  110  population  of  .583,  for  the  60  population 
of  .493. 

Manipulation  of  Spatial  Relationships  Speed  Test  (Test  10). — 
This  test  was  given  before  Test  9,  the  spatial  power  test.  In  fact, 
it  was  due  to  the  difficulties  discovered  in  the  administration  of 
Test  10,  and  largely  overcome  in  giving  Test  9,  that  fair  scores 
were  secured  throughout  on  Test  9.  Many  of  the  pupils  did  not 
adequately  grasp  the  directions  for  Test  10,  with  the  result  that 
both  the  third-  and  seventh-grade  populations,  for  which  we  have 
fair  Test  10  scores,  are  considerably  reduced  in  size.  For  certain 
seventh-grade  classes  the  only  directions  were  those  printed  on  the 
blank  (see  page  173).  These  proved  inadequate  and  were  later 
supplemented  both  in  the  seventh  grade  and  in  the  third  grade,  the 
following  statement  being  representative  of  the  third-grade  admin- 
istration (page  173  is  before  the  pupils). 

Look  at  the  first  row  of  figures  for  the  "figure  exercises."  I  have 
here  a  chart  on  the  blackboard  just  like  the  one  that  is  drawn  on  the 
papers.  Here  is  the  row  of  figures  A,  B,  1,  2,  3,  4,  5,  6,  and  7.  Each 
of  the  figures  to  the  right  of  this  heavy  line  can  be  cut  up  into  the  two 
figures  A  and  B.  With  your  pencil  draw  a  line  in  each  of  these  figures 
1,  2,  3,  4,  5,  6,  and  7,  cutting  it  up  into  two  figures  like  A  and  B.  Do 
it  right  now.  [After  one  and  one-half  minutes]  Stop.  [Draw  and  point 
to  the  blackboard  figures  as  necessary.]  Now,  if  you  drew  the  line  cor- 
rectly in  this  first  figure  you  will  have  a  line  right  down  here,  because 
that  cuts  this  one  off,  which  is  the  same  as  this.  In  Figure  3  you 
would  have  a  line  right  across  here.  Is  there  anyone  who  doesn't  under- 
stand what  I  want  you  to  do?  Now,  look  at  this  upper  part.  Can  this 
upper  part  be  turned  around  without  turning  over  so  that  it  will  fit 
Figure  A  ?  [Examiner  demonstrates  with  the  aid  of  cardboard  samples 
of  figures.]  No,  it  cannot,  so  I  want  you  to  write  a  letter  t  in  the 
upper  part.  The  /  means  that  the  upper  part  has  to  be  "turned  over" 
to  fit.  Now,  let  us  look  at  Figure  4.  Does  this  need  to  be  turned  over? 
No,  it  does  not.  Nothing  needs  to  be  turned  over  here.  Look  at  Figure 
5.  This  part  does  not  need  to  be  turned  over,  neither  does  this  other 
part.  Look  at  Figure  6.  Does  the  upper  part  need  to  be  turned  over  ? 
Yes,  it  has  to  be  turned  over ;  I  cannot  make  it  fit  otherwise.  So  I  want 
you  to  write  the  letter  /  in  the  upper  part.   Look  at  Figure  7.   Does  any- 
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thing  need  to  be  turned  over  here?  No,  so  you  do  not  need  to  write  /. 
Now,  let  us  look  at  the  row  at  the  bottom  of  the  page.  You  want  to 
remember  that  every  figure  1,  2,  3,  4,  5,  6,  7  is  to  be  divided  by  a  line 
cutting  it  into  two  parts,  thus  making  figures  A  and  B,  and  second,  you 
are  to  write  the  letter  /  in  each  part  that  must  be  turned  over  in  order 
to  make  Figure  A.  Do  this  whole  row  on  your  paper  as  rapidly  as  you 
can.  Do  it  right  now.  [After  one  and  one-half  minutes]  Stop.  Now, 
on  pages  6  and  7  we  have  a  lot  more  just  like  this.  I  want  you  to  do 
the  same  thing.  Be  sure  to  have  each  one  right,  but  work  as  fast  as  you 
can.  Work  with  your  blue  pencils.  Ready,  go.  [After  1 1  minutes  in  the 
third  grade  and  8  minutes  in  the  seventh  grade]  Stop.  [This  terminated 
the  test  for  the  third  grade,  but  for  the  seventh  it  continued  as  follows :] 
Use  your  red  pencils  and  continue.  [After  3  minutes.  At  one  sitting  for 
one  class,  but  2  minutes  was  given  here  and  an  adjustment  in  the  score 
was  made  to  allow  for  this  shortened  time.]  Stop.  Will  the  children  in 
the  back  seats  collect  the  papers. 

For  the  seventh  grade,  scores  for  both  the  eight-  and  the 
eleven-minute  periods  were  investigated,  but  the  final  score  is 
based  upon  a  working  time  of  eight  minutes  for  both  third  and 
seventh  grades.  Three  scores  were  studied,  (a)  S1}  the  number 
attempted,  (b)  S2,  the  number  of  figures  correctly  "lined"  and  cor- 
rectly "t'd,"  i.e.,  the  number  that  had  been  correctly  divided  into 
parts,  and  also  in  which  t's  occurred  in  just  those  parts  that  require 
turning  over,  (c)  S3,  which  is  given  by  the  equation 

S3  =  S2  +  lA  (tne  number  correctly  lined  but  incorrectly  t'd). 

Optimum  scores  involving  (S2  +  cS3),  (S2  +  cSi),  and 
(S3  -f-  cSx)  were  determined.  The  score  finally  decided  upon  for 
the  seventh  grade  was  S2,  or  the  number  correctly  lined  and  cor- 
rectly t'd  in  eight  minutes.  This  has  a  reliability  for  the  popula- 
tion of  109  of  .738  (the  optimum  reliability  was  .753). 

For  the  third  grade  the  scoring  scheme  adopted  for  the  seventh 
grade  was  used  without  a  redetermination  of  the  optimum  scheme, 
but  the  working  time  was  eleven  minutes  instead  of  eight.  For 
the  population  of  60  the  reliability  is  .575. 

Manipulation  of  Spatial  Relationships  Pozver  Test  (Test  9). — 
The  directions  as  printed  on  the  test  blank  (see  page  178)  were 
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first  carefully  followed.  As  these  proved  insufficient,  additional 
practice,  using  a  large-scale  sheet,  showing  row  a  of  the  test  proper 
and  the  figures  at  the  top,  was  pinned  to  the  wall  and  utilized  as 
follows : 

In  Row  a  (Form  A),  just  below  the  heavy  line  at  the  top  of  the 
page,  there  are  some  figures  made  up  of  the  figure  at  the  left  of  the 
heavy  line  and  one  figure  of  those  numbered  at  the  top  1,  2,  3,  4,  5,  6, 
7,  8.  Which  figure  at  the  top  is  required?  Figure  6  is  correct,  so  write 
the  number  "6"  at  the  beginning  of  the  row  right  next  to  the  little 
letter  a.  Now,  do  this  row  just  as  you  did  the  sample  row  on  the 
directions  page.  Write  above  each  figure  the  number  of  parts  that  must 
be  turned  over.  Start  now,  but  do  not  continue  with  the  second  row 
until  I  tell  you  to.  [If,  due  to  transfer  from  Test  10,  certain  pupils 
write  t  on  the  figures,  they  should  be  individually  advised  as  to  the 
correct  procedure.  Allow  two  minutes  in  the  third  grade  and  one  min- 
ute in  the  seventh.]    Stop. 

Look  at  Row  b.  What  figure  at  the  top  must  be  used  in  connection 
with  the  figure  at  the  left  of  the  heavy  line  to  make  the  figures  of  this 
row  ?  Yes,  Figure  1  at  the  top  is  required.  This  figure  is  also  required 
for  Row  c,  so  write  the  number  "1"  beside  the  small  letters  b  and  c, 
and  then  do  these  two  rows.  Ready,  go.  [Allow  3  minutes  in  third 
grade  and  2  minutes  in  seventh  grade.]    Stop. 

Now  look  at  Row  d.  What  figure  at  the  top  is  needed  ?  Figure  8  is 
required,  so  write  the  number  "8"  beside  the  small  letter  d,  and  do  this 
row  as  you  did  the  first  three.  In  this  row  each  figure  is  made  up  of 
three  separate  parts  instead  of  two,  so  you  will  need  to  draw  two  lines 
cutting  up  each  figure,  and  you  must  write  down  the  number  showing 
the  number  of  pieces  that  must  be  turned  over.  Remember,  never  turn 
a  piece  over  unless  you  are  unable  to  make  it  fit  in  any  other  way. 
[Allow  2  minutes  in  third  grade  and  1  minute  15  seconds  in  seventh.] 
Stop. 

Look  at  Row  e.  Figure  4  at  the  top  is  needed,  so  write  the  number 
"4"  next  to  letter  e  and  do  this  row.  [Allow  2  minutes  20  seconds  in 
third  grade  and  1  minute  50  seconds  in  seventh.]    Stop. 

Look  at  Row  /.  Figure  7  at  the  top  is  needed,  both  for  this  row  and 
for  Row  g,  so  write  the  number  "7"  beside  letters  /  and  g  and  do  these 
two  rows.  [Allow  4  minutes  30  seconds  in  third  grade  and  3  minutes 
40  seconds  in  seventh.  As  this  is  too  hard  for  most  third-grade  pupils, 
assistant  may  tell  pupils  singly,  who  have  plainly  reached  their  limit, 
not  to  attempt  any  more.]    Stop. 
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Look  at  Row  h.  Figure  2  at  the  top  is  needed,  so  write  the  number 
"2"  next  to  the  letter  h  and  do  this  row,  but  do  not  go  on  to  Rows  i 
and  j  [assistant  is  to  see  that  this  instruction  is  obeyed].  Remember 
you  are  not  to  draw  any  lines  in  Rows  ;'  and  /'  until  I  tell  you  to. 
Ready,  go.  [Allow  3  minutes  in  third  grade  and  3  minutes  40  seconds  in 
seventh.]    Stop. 

Now  look  at  Row  *".  Figure  2  is  needed  for  this  row,  and  also  for 
Row  j,  so  write  "2"  next  to  letters  i  and  /.  In  these  two  rows  I  want 
you  to  write  down  as  before  the  number  of  parts  necessary  to  turn 
over,  but  here  you  must  not  draw  any  lines  cutting  up  the  various 
figures.  Just  imagine  these  lines ;  do  not  draw  them.  I  know  it  is  harder 
to  determine  how  many  parts  have  to  be  turned  over  when  no  lines 
cutting  up  the  figures  are  drawn,  but  I  want  to  see  if  you  are  able  to 
imagine  the  lines  without  drawing  them,  so  write  above  every  figure  in 
Rows  i  and  /  the  number  of  parts  that  must  be  turned  over,  but  do  not 
draw  any  lines  cutting  up  these  figures.  [Assistant  must  see  that  this 
instruction  is  rigidly  followed.  If  any  pupil  shows  an  inclination  to 
draw  light  lines  or  draw  lines  and  then  erase  them,  he  must  be  kept 
under  surveillance  so  that  this  is  impossible.]  Ready,  go.  [Not  given  to 
third  grade.   Allow  6  minutes  in  the  seventh.]    Stop. 

The  scores  investigated  were  Plf  the  number  of  figures  cor- 
rectly lined  and  numbered  as  regards  the  number  of  parts  neces- 
sary to  turn  over,  and  P2,  which  is  equal  to  (Px  +  %-P3),  in  which 
P3  is  the  number  correctly  lined  but  incorrectly  numbered.  Opti- 
mum scoring  schemes  were  found  for  both  third  and  seventh 
grades,  but  that  finally  used  differed  somewhat  from  both  of  these. 
It  was  (P-l+Yiq  Po).  Though  this  is  the  form  in  which  it  was  actu- 
ally used,  it  is  readily  seen  that  this  is  equivalent  to  (Px  -f  y80  P3), 
or  the  number  of  figures  correct  in  every  respect,  plus  %0  OI  the 
number  correctly  lined  but  incorrectly  numbered.  With  reference 
to  further  work  the  writer  would  say  that  there  is  not  sufficient 
difference  between  this  scoring  scheme  and  the  use  of  Px  alone  to 
warrant  its  use.  The  scoring  scheme  has  a  reliability  for  the  140 
population  of  .781  (the  optimum  would  have  been  .782),  for  the 
109  population  of  .753,  for  the  110  population  of  .710,  and  for 
the  60  population  of  .612. 
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Copies  of  all  the  new  tests  used,  i.e.,  of  Numbers  1,  3,  5,  6,  7, 
8,  9,  10  are  given  herewith,  reduced  to  just  %  the  original  size, 
together  with  such  printed  instructions  as  appeared  on  the  test 
blanks.  The  instructions  were  not  repeated  in  full  when  the  second 
forms  of  the  tests  were  given. 


FORM  A 
Booklet  of  Speed  Tests  (Page  1) 

DIRECTIONS 

Name  -Boy  or  Girl Date. 

(Firit  nanc)  (Last  name) 

Age When  is  your  next  birthday? School. .. 

How  old  will  you  be  then? Grade 


READING  EXERCISE 

In  the  following  story  there  is  a  parenthesis  every  few  words.  In  each  parenthesis  are  two 
words,  one  of  which  does  not  belong  there  because  it  does  not  make  good  sense  in  the  sentence. 
You  are  to  read  these  sentences  when  I  tell  you  to  start  and  whenever  you  come  to  a  parenthesis, 
rapidly  draw  a  line  under  the  right  word,  and  then  continue  reading  as  fast  as  you  can,  until  I  tell 
you  to  stop.  Ready — go. 

WHEN  THE  TRAIN  PASSES 

I  live  within  one-half  mile  of  the  railroad  (map,  tracks).  I  see  the  trains  pass  many  times 
and  it  always  gives  me  a  (thrill,  penny)  to  watch  them.  First  is  the  big,  black  engine  in 
(front,  school),  making  an  awful  noise,  spitting  fire  and  racing  down  the  shiny  (lake,  rails). 
I  like  to  watch  it  from  beneath  a  big  oak  (chair,  tree)  by  the  roadside.  With  such  a  monster 
loose,  one  needs  a  friendly  oak  to  (protect,  scare)  him. 

Stop  (after  15  seconds).  What  word  did  you  draw  a  line  under  in  the  first  parenthesis? 
"Tracks"  is  right,  because  now  the  sentence  reads,  "I  live  within  one-half  mile  of  the  railroad 
tracks."  What  word  did  you  draw  a  line  under  in  the  next  parenthesis?  "Thrill"  is  right;  and 
in  the  next  parenthesis  the  right  word  is  "front."  On  Pages  2  and  3  are  two  other  exercises  in 
which  I  want  you  to  do  the  same  thing.  In  each  parenthesis  draw  a  line  under  the  right  word. 
Do  it  as  fast  as  you  can.  Turn  to  Page  2.   Ready — go. 

Stop  (after  just  five  minutes). 
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READING  EXERCISE 
FUN  IN  THE  SNOW 

When  I  went  to  bed  that  (morning,  night),  it  was  very  windy  and  cold.  There  were  few 
clouds  in  the  (sky,  road),  so  I  was  quite  surprised  the  next  (time,  morning)  to  hear  Father  say, 
"Get  up,  Harry,  and  see  the  (snow,  sunshine).  It  has  been  snowing  all  night,  and  now  every- 
thing is  (green,  white).  Come  to  the  window  and  see."  And  Mother  said,  "I  am  afraid  there 
is  so  much  (snow,  dust)  on  the  ground  that  Harry  will  not  be  able  to  go  to  school  today."  Did 
I  bury  my  head  in  the  (pillow,  sand)  and  cry  over  this  sad  news?  No!  I  did  not.  I  ran  to  the 
window  and  looked  (in,  out).  Sure  enough!  The  whole  world  outside  was  covered  with  white 
snow,  piled  high  about  the  (sides,  tables)  of  the  houses  and  the  walls,  where  it  had  been  blown 
by  the  (fan,  wind).  In  our  back  yard  there  were  deep  holes  (in,  above)  the  snow  made  by  the 
feet  of  the  milkman,  who  comes  early  in  the  (springtime,  morning)  with  the  milk. 

After  breakfast  the  sun  came  out  and  (spoke,  shone)  brightly.  The  snow  began  to  melt  a 
little.  This  made  it  very  good  for  making  (toys,  snowballs).  When  I  looked  out  the  back  win- 
dow I  saw  that  Mr.  Thomas,  the  (man,  woman)  who  lives  next  door,  was  digging  a  path  from 
(his,  her)  house  to  ours.  Soon  Billy  Thomas  came  out  and  (whispered,  shouted)  to  me  to  come 
and  help.  Billy  is  half  a  year  older  than  I,  but  we  (live,  play)  together  all  the  time. 

Mother  gave  me  my  brown  coat  and  wool  cap,  and  I  put  on  my  big  boots  and  (looked,  ran) 
out.  The  snow  was  up  to  my  knees  in  most  places.  I  began  to  help  Mr.  Thomas  (dig,  measure) 
the  path,  but  when  Billy  made  a  snowball  and  threw  it  at  me,  (I,  she)  found  it  more  interesting 
to  make  snowballs  than  to  dig  the  path.  That  started  a  (rock,  snow)  fight,  but  it  was  only  in  fun. 
The  soft  snow  did  not  hurt  at  all.  Billy's  two  big  (brothers,  sisters),  Jenny  and  Alice,  came  out 
of  the  house  and  we  both  attacked  them  fiercely  with  the  biggest  (stones,  snowballs)  we  could 
throw.  Jenny  caught  me  and  (Alice,  Gertrude)  caught  Billy  and  they  washed  our  faces  in  the 
snow.  We  decided  it  was  not  polite  to  throw  snowballs  (at,  for)  girls,  so  we  stopped  and  asked 
them  if  they  wouldn't  help  us  make  a  (cart,  snow)  man.  We  rolled  a  great  big  snowball  for  the 
man's  body  and  a  smaller  one  for  his  (coat,  head).  In  this  we  put  pieces  of  coal  for  eyes.  His 
nose  was  an  old  stick  of  wood,  and  we  (put,  found)  an  old  hat  on  his  head.  Billy  called  the  man 
Mr.  Williams, — that's  Jenny's  beau, — and  he  got  his  (hands,  face)  washed  a  second  time. 

During  the  next  night  it  became  very  (sunny,  cold)  and  the  softened  snow  had  frozen  so 
hard  that  the  surface  would  bear  our  (weight,  boat)  and  we  walked  over  the  top  of  the  snow 
instead  of  wading  (through,  around)  it.  Billy  Thomas  and  I  began  to  dig  the  (soft,  black)  snow 
from  beneath  the  crust  and  soon  had  a  lovely  cave  under  a  snowbank  beside  the  (path,  bed). 
Although  it  was  very  cold  outside,  it  was  quite  warm  in  the  (shed,  cave)  and  we  could  look  up 
through  our  (icy,  shingle)  roof  at  the  sun  and  found  it  was  like  (looking,  walking)  through 
frosted  glass,  only  the  glass  seemed  to  be  made  of  rainbows. 

As  the  weather  continued  very  (hot,  cold),  we  poured  a  little  water  over  our  roof  each  night 
and  soon  had  a  very  strong  coating  of  (ice,  paint)  which  lasted  several  weeks.  We  worked  each 
(day,  year)  making  the  cave  a  little  larger  and  finally  had  two  (rooms,  boxes)  with  walls  of  snow 
between.  We  could  stand  upright  in  the  (center,  edge)  of  the  cave,  but  Billy  and  I  are  not  very 
(heavy,  tall). 

The  snow  man  stood  guard  (beside,  inside)  the  cave  and  we  made  everyone  who  came  to  see 
us  leave  a  (rubber,  snow")  ball  at  his  feet.  Soon  we  had  a  large  store  of  (chestnuts,  ammunition), 
and  then  we  had  a  party  and  a  big  (pillow,  snowball)  fight.  Anyone  who  could  break  through 
the  line  of  (defense,  march)  and  get  into  the  cave,  had  the  right  to  fire  these  (rubber,  snow) 
balls  from  the  rear.  We  were  very  hungry  when  the  fight  finished  and  Mother  let  us  have  hot 
doughnuts  to  (eat,  sell)  in  the  cave. 

Go  right  on  to  the  next  story  and  do  the  same  thing. 


168  CROSSROADS  IN  THE  MIND  OF  MAN 

FORM  A 
Booklet  of  Speed  Tests  (Page  3) 

JACK'S  KITE 

"Look  at  what  my  papa  (sang,  gave)  me.  Isn't  it  a  beauty?  I  bet  it  will  fly  higher  than 
any  other  (kite,  cart)  in  town."  Jack's  kite  was  certainly  a  (bitter,  nice)  one.  It  had  a  dragon's 
head  right  on  the  (front,  inside)  of  it.  Its  tail  was  made  of  little  bunches  of  paper  tied  on  a 
(pole,  string),  and  each  bunch  was  of  a  different  (frame,  color).  All  the  children  wanted  to  see  it 
fly,  so  they  went  (up,  tonight)  to  the  top  of  the  hill,  where  there  was  more  (wind,  water).  Jack 
didn't  know  very  much  about  flying  kites  and  Arthur  offered  to  (show,  ask)  him  how.  Jack  was 
afraid  to  let  anybody  else  (make,  touch)  his  fine  kite.  He  would  not  even  let  Arthur  hold  it  while 
he  pulled  the  (string,  plow).  Instead  of  letting  anyone  help  him  get  it  into  the  air  he  tried  to 
throw  it  up  and  get  it  (started,  back)  that  way.  He  did  not  succeed  and  the  kite  fell  down  with 
a  bang.  Jack  was  afraid  that  it  was  broken.  When  he  picked  it  up  the  dragon  looked  as  fierce  as 
ever  and  the  tail  danced  in  the  (wind,  winter).  Everything  seemed  to  be  all  right.  He  tried  again, 
but  this  time  he  let  Arthur  help  (him,  us).  Jack  let  out  quite  a  bit  of  string  and  Arthur  held 
the  (clock,  kite^  high  above  his  head,  ready  to  let  it  go  when  Jack  should  pull  the  (string,  grain). 
Just  then  a  good  breeze  sprang  up  and  Jack  called  (Joe,  out),  "Let  her  go !"  Immediately  the  kite 
soared  upward  and  soon  it  was  way  up  by  the  chimney  tops.  The  red  and  green  dragon  was 
bobbing  about  and  wagging  its  tail  in  great  (size,  style).  Jack  felt  so  happy  that  he  asked  Arthur 
if  he  didn't  want  to  (stop,  fly)  it  for  a  while 

Arthur  wrote  on  a  small  piece  of  paper,  "Hello!  Blue  Sky,  isn't  this  a  fine  (box,  kite)  ?"  He 
made  a  little  hole  in  the  paper  and  put  it  on  the  string  and  the  (fan,  wind)  blew  it  away  up  to 
the  kite.  Almost  as  soon  as  the  message  got  up  there  a  strong  puff  of  (wind,  smoke)  struck 
the  kite  and  made  it  dance  vigorously.  Arthur  cried  out  in  glee,  "That  is  Blue  Sky  saying  that 
he  thinks  it  is  a  mighty  fine  (cart,  kite)."  Another  puff  tore  the  message  from  the  (boy,  string) 
and  carried  it  higher  and  higher  until  it  was  finally  lost  to  sight.  Arthur  said,  "I  suppose 
(Clear,  Blue)  Sky  thought  it  would  not  be  polite  to  send  our  message  back,  so  he  just  took  it 
away  (with,  from)  him."  Blue  Sky  developed  very  decided  opinions  of  his  own  and  continually 
made  the  kite  race  back  and  (in,  forth)  and  back  and  forth  and  dive  and  (soar,  swim).  Jack  was 
afraid  the  entire  kite  would  break  (loose,  somebody)  and  blow  away,  so  he  asked  Arthur  to  pull 
it  (out,  in).  This  seemed  to  make  Blue  Sky  mad,  for  the  kite  jumped  and  pulled  harder  than 
(rocks,  ever)  and  finally  in  a  grand  swing  dove  down  to  the  ground  (back,  inside)  of  a  house.  Jack 
began  to  cry,  thinking  his  kite  was  (gathered,  broken)  into  pieces.  They  went  to  find  it  and  soon 
saw  its  tail  way  up  on  a  (piano,  telephone)  wire.  Soon  they  found  the  kite  itself  sticking  in  the 
mud  of  a  vegetable  (cart,  garden),  none  the  worse  for  its  wild  flight  except  that  it  had  lost  its 
(tail,  mind).  Jack  didn't  know  whether  to  cry  or  not,  but  Arthur  said,  "Come  on,  let's  (go,  fly) 
home"  and  he  sang  out,  "It  hung  its  tail  on  a  telephone  (wire,  pole)  and  it  sat  down  nicely  in  the- 
mire."  Jack's  tears  disappeared  and  as  (we,  they)  trudged  home  he  joined  in  the  chorus,  "And 
it  sat  down  nicely  in  the  (chair,  mire)." 
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Add: 

8 
3 

13,  11 
Add: 


16.14 


ARITHMETIC  EXERCISE 


9,7 


12,14 


22,19 


20,23 


26,19  13,16  17,18  15,25 

Go  right  on  with  the  problems  on  page  5. 


25,23 


20,24 


17,14  13,17 
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7 
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3 

7 

7 

9 

4 
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5 
9 
8 

5 

4 
7 

8 

4 
7 

19,16 

2 
6 
8 

12.15 

19,21 

19,17 

19,16 
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16.  17 

16,18 

Subtract: 

11 
7 

16 

5 

18 
3 

12 
7 

15 
6 

19 

8 

19 
4 

11 
6 

3,4 

9,11 

17.  15 

5,9 

9,6 

13.  11 

15,13 

3,5 

Subtract: 

14 
9 

18 

4 

17 

5 

15 

7 

12 
8 

4,5 

13 
6 

16 

7 

19 
7 

5,7 

14.16 

11,12 

8,5 

6,7 

7,9 

12,14 

Multiply: 

2X5=15, 

10 

5X3  = 

=  15, 

20 

3X2  = 

=  6, 

8 

4X3  = 

=  14,  12 

Multiply: 

4X5  =  25, 

20 

5X5  = 

=  25, 

35 

4X4  = 

=  16,  18 

2X4  = 

=  8,  12 

Divide: 

10-2  =  4, 

5 

8-5-2  = 

=  4, 

2 

8-* 

4  = 

=  2, 

3 

6- 

-2  = 

=  2,  3 

Divide: 

6-3  =  2, 

3 

10-5-5  = 

=  3, 

2 

4- 

2  = 

=  3, 

2 

9- 

-3  = 

=  3,  4 

Add: 

9 
6 
8 
3 

2 
5 
2 
7. 

5 
2 
7 
4 

9 

3 
8 

5 

8 
2 
8 

7 

6 
7 
4 
3 

3 
9 
8 

5 

9 

2 
7 
8 

25,  27  26, 28 
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6 

3 

8 

2 

9 

7 

8 

3 

7 

S 

5 

9 

9 

8 

9 

6 

9 

9 

6 

4 

8 

3 

7 

1 

9 

6 

7 

6 

7 

9 

8 

8 

33,31  23,17  26,25  21,23 

Subtract: 


32,33  31,27  35,32  18,16 


23                  22 

28                  28 

20                   27 

25 

21 

17                   13 

15                   19 

13                   16 

17 

14 

6,  5                9, 7 

13, 16               9, 7 

5,7               11,7 

4,i 

!                8,7 

Subtract: 

29                   29 

27                   26 

29                  29 

26 

28 

14                    12 

13                   18 

11                   17 

19 

16 

11,15             17,15 

13, 14               6, 8 

16, 18             12, 14 

8,  7               17, 12 

Multiply: 

4X8  =  32,  36 

5X7  =  35,  36 

5X6  =  30,  35 

4X9  =  38,  36 

Multiply: 

4X7  =  27,  28 

2X7=17,  14 

4  X  8  =  38,  32 

5  X  9  =  49,  45 

Divide: 

14-4-2  =  7,  6 

15-3  =  5,  10 

18-*-3  =  8,  6 

12-4  =  3,  4 

Divide: 

20-4  =  6,  5 

16-5-4=4,  3 

18-6  =  4,  3 

18-9  =  4,  2 

Multiply: 

6X9  =  54,  57 

8X7  =  48,  56 

7X6  =  42,  46 

9X8  =  68,  72 

Multiply: 

9  X  7  =  63,  72 

7X7  =  46,  49 

9X9  =  89,  81 

6  X  8  =  52,  48 

Divide: 

SO-*- 10=5,  10 

36-12  =  3,  4 

44  -  1 1  =  6,  4 

48-12  =  4,  6 

Divide: 

38-:- 19  =  2,  3 

45-*- 15  =  3,  2 

39-13  =  3,  6 

42-14  =  5,  3 

FORM  A 
Booklet  of  Speed  Tests  (Page  6) 
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d>M  k  ^>  &  tf  ^  ^r  ^ 


b^^Z?    <?  o   t\  <b    Q 


Go  rights  on  to  the  next  page. 
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COMPUTATION  EXERCISES 

Below  are  some  arithmetic  problems.  After  each  problem  are  two  answers,  but  only  one 
of  them  is  right.  You  are  to  do  the  problems  in  order  as  you  come  to  them,  drawing  a  line 
under  the  correct  answer.   Ready — go. 


Add: 


Multiply: 

3X4  =  22,  12 


7,9 


Divide: 
15- 


5  =  5,  3 


11,13 
(Allow  yi  minute.) 

The  number  that  should  have  a  line  under  it  in  the  first  problem  is  11.  In  the  second  problem 
it  is  nine.  In  the  third  problem  there  should  be  a  line  under  12,  and  in  the  fourth  problem  under  3. 
How  many  got  them  all  right? 

Now  turn  to  pages  4  and  5  and  work  the  problems  in  order.  Work  as  fast  as  you  can.  Draw 
a  line  under  the  correct  answer.  Ready — go.   (Allow  3  minutes.)    Stop. 

DIRECTIONS  FOR  FIGURE  EXERCISE  No.  1 
Below  is  a  row  of  figures,  A,  B,  1,  2,  3,  4,  5,  6,  7.   Each  of  the  figures  1,  2,  3,  4,  5,  6,  7  to  the 
right  of  the  heavy  line  can  be  cut  up  into  the  two  figures  A  and  B  shown  at  the  left  of  the  line. 
With  your  pencil  draw  a  line  on  each  of  the  figures  numbered  1,  2,  3,  4,  5,  6,  7-  showing  just  how 
each  must  be  cut  in  order  to  make  two  figures  A  and  B.   Do  it  now. 
ABl  2  3  4  5  6  7 


hfl 


t^H&  ftStt 


(Allow  y2  minute.)  Look  closely  at  figure  3.  I 
can  you  turn  the  upper  part  around  without  lift 
or  is  it  necessary  that  you  turn  this  upper  part  o 
over,  for  otherwise  it  is  impossible  to  make  it  fi 
write  the  small  letter  "t"  meaning  "turned  over 
can  find  another  figure  in  which  it  is  necessary  t 
figure  A.  How  about  figure  1  ?  No  part  of  figur 
we  will  go  on  to  figure  2.  Look  carefully.  Can  t 
top  without  turning  it  over  and  be  made  to  fit  e 
to  figure  4.  Here  again  nothing  needs  to  be  turne 
needs  to  be  turned  over,  so  we  will  look  at  figur 
cut  off  fit  figure  A,  by  moving  it  around  on  a  tab 
I  want  you  to  write  the  letter  "t"  in  the  upper  pa 
turned  over  in  order  to  make  figure  A.  Look  at 
Below  is  another  row  in  which  you  are  to  d 
3,  4,  5,  6,  7,  draw  a  line  cutting  it  into  two  part 
letter  "t"  in  each  part  that  must  be  turned  over  i 
as  you  can,  but  be  sure  that  you  do  it  correctly. 
ABl  2  3 


f  you  cut  it  where  you  have  just  drawn  a  line, 
ing  it  from  a  flat  table  top  so  as  to  make  figure  A, 
ver  in  order  to  make  figure  A?  It  must  be  turned 
t  exactly  on  figure  A.  Therefore  I  want  you  to 
"  on  this  upper  part  of  figure  3.  Let  us  see  if  we 
o  turn  the  piece  over  before  it  will  exactly  match 
e  1  needs  to  be  turned  over  to  make  figure  A,  so 
he  part  cut  off  be  moved  around  on  a  flat  table 
xactly  on  figure  A?  Yes,  it  can,  so  we  will  go  on 
d  over,  so  we  will  look  at  figure  5.  Again  nothing 
e  6.  There  is  no  possible  way  of  making  the  part 
le  top.  It  simply  must  be  turned  over.  Therefore 
rt  of  figure  6.  That  is,  in  the  part  which  must  be 
figure  7.  Nothing  needs  to  be  turned  over, 
o  the  same  thing.  Remember  in  each  figure  1,  2, 
s  making  figures  A  and  B,  and  second,  write  the 
n  order  to  make  figure  A.  .Do  the  row  as  rapidly 
(Allow  1  minute.) 

4  5  6  7 


On  Pages  6  and  7  are  more  rows  of  figures  on  which  I  want  you  to  do  the  same  thing.  Turn 
to  Page  6.  Be  sure  you  have  each  one  right,  but  work  as  fast  as  you  can.  Ready — go.  (Allow 
11  minutes.) 
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Name. 


an 

is 

* 

g 

1 

0 

t 

my 

* 

on 

* 

in*           *be 

of*           *to 

am* 

♦  we 

is  *           *  go 

be  *           *  us 

to*                *us 

as  *       2        * ne 

is* 

}       *no 

by*       4       *or 

of*       5       *so 

am*           *up 

* 

it*           *at 

* 

do* 

*or 

k 

at*           *so 

* 

no  *           *  do 

* 

he 

on 

l 

f 

up 

as 

*          * 

D.4,8 

8    A 

>         * 

*           * 

A  *   6   *0 

^*      7     *00 

O    i 

3     *A<&*     9    *□ 

<?*    10     *ffl 

o  ' 

0'6-D 

**J*(5 

*VA 

*       * 
00  ^ 

5 

2*    *    *3 

5 

7*          *8 

5* 

8 

* 
*6 

7 
5*          *4 

9 
3*          *5 

7*     11      *8 

3*     12     *4 

2*      13      *3 

8*      14      *2 

7*      15      *6 

4*         *9 

* 

6 

6*          *9 

• 

2 

4* 

*9 

* 

7 

3*         *9 

* 

6 

4*          *2 

* 

8 

*.**.* 

^Ja 

St*    16    *^0 

pU    17    *-€\ 

\£*      18     *"(! 

0*     19    *# 

2S*  20  *>7 

_.*        *  i 

*         *. 

6- 

*  4  «■ 

y  *              *■ 

as 

* 

if 

* 

is 

* 

no 

* 

my*           *or 

my* 

*us 

do  *           *  to 

am*           *so 

if*      21       *of 

it*    22 

*we 

no*       23       *we 

1 

ip*       24       *at 

an  *           *  he 

* 

to* 

* 

*do 

if*           *go 

* 

be  *           *  we 

* 

go 

an 

at 

it 
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d*  25    *& 

<?*    26   *D 

e*  27  *j 

^      fl 

O    28    *A 

A  u 

6*    29    *V 

0"n° 

96 

48*     *    *20 

53*     30     *« 

58*         *15 
* 
63 

91 

44*         *74 

49*     31      *68 

54*          *16 

* 

11 

78 

66*          *60 

97*     32     *65 

41*          *73 

• 
85 

30 

17*          *31 

61*     33     *99 

93*          *56 

* 
36 

27 

33*          .83 

40*     34      .28 

89*          .46 

* 

59 

^*    35    *"^ 

1 — 

7^*    36    *"£ 

v*   • 
ti  a  * 

\o 
*£*    36     *^ 

*  *  v 

^>*    39'"*^ 

own 

* 

son  *           *  got 

way  *      40      *  Put 

why*           *  but 

* 

eat 

get 

• 
cut  *           *  say 

air*      41       *now 

has*           *she 

* 
how 

had 

* 

him*           *out 

has*     42     *Pay 

got  *           *  did 

* 

she 

his 

* 

pay  *           *  not 

the  *      43      * are 

any*           *its 

* 
day 

CD*    AA    *<s? 

°   A  ° 

□  *    45   *0O 

p***A 
1     a 

A      A 

t£j*    46    *0 

*Y3 

SI*    17  «0 

Q*   48    *0 

00*  *  *A 
A 
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525 

216 

812 

307 

685 

978*          *692 

669*          *835 

264*          *431 

365*          *771 

337*          *224 

430*     49     *240  1 

21*     50      *383 

717*     51      *979 

423*     52      *655  982*      53      *576 

882*          *787 

573*          *931 

169*          *526 

481*          *132 

630*          *443 

335 

478 

622 

539 

279 

\t* 

**?/ 

o>J** 

7^ 

2>*    54    *K 

•£*    55    *^ 

^T*    5  6    *-J 

<#*    57    *<& 

<$*    55    *\ 

"7" 

*VA 

«  » *" 

*        * . 

1  %,* 

tell 

* 

soon*          *rest 

hope 

* 

hear  *           *  said 

wait 

* 

dear  *           *  rich 

done 

* 

lost  *           *  want 

live  *      59      *  ^oes 

late  *      ^JO      *  such 

were*      61       *each 

went  *      62      * save 

fill*           *that 

from*           *when 

glad  *           *  with 

will  *           *  move 

poor 

wish 

pass 

fine 

8.7J> 

°  n 

p.^*e 

0**8 

^*    63   *P 

gj*    64    *  A 

O*    65   *■& 

<?*   66   *£i 

ft*    67    *0 

G'n  *ffl 

*              *A 

ft*  *  *G> 

°Vffl 

D'6'A 

«A*- 

>*   *   *->r 

3±*            * 

*$.*    68    *^> 

-€\*    69    *■&- 

*5*    70     **/ 

*^r*     7\      *+j 

-^*     71    *& 

*V* 

ic^y 

-7     *   *^ 
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carry 

begin 

early 

heavy 

begin  *           *  given 

about  *           *  never 

visit*           *  being 

about  *           *  given 

other*      73      *  early 

along  *      74      *  other 

happy  *      75       *  about 

other*      76      *  today 

again*           *  along 

again  *           *  visit 

order*           *  alone 

until  *           *  never 

alone 

heavy 

often 

cover 

4  *6jb 

<>.?□ 

o.?.o 

O     TOO 
*        * 

ffl*    ^  *C7 

A*    77    *0 

r£i*    75    *«=> 

□  *    79   *£7 

A*  80    */j 

ft  *  81    *8 

o*6*° 

**  tf7 

*V* 

**j* 

*X* 

z7*        • 

7),   *   *^5 

rV*    82    *P 

(^*    83    *-J 

32*    84      *^r 

?J*    85    *ty 

n>*  86  *^ 

">> 

*    ^    * 

.  *          *,, 

s?Ao 

~>0 

A 

ffl*  *e*o 

P*  *  *8 

^)*    57    *cn 

ffl*    88    *A 

P*    89    *0 

O*    90   *oo 

ft*    91     *0 

P*  *  *o 

'      oo  w 

-A.*            * 

*           L.        *   A 

P  A* 

o   £    BB 

•     * 

r    *    ^\ 

-**  *  ** 

Gj*    92    *\> 

^*    93    *^] 

£?*    94     */•" 

*€<*    95     *^ 

***    96    *v5» 

'V* 

*Y* 

GJ     ^    "* 

j*        *^ 

178  CROSSROADS  IN  THE  MIND  OF  MAN 

FORM  A 
Spatial  Relationships  Power  Test   (Page  1) 

Name , - Date 

<Fic«  name)  (Last  name) 


DIRECTIONS  FOR  FIGURE  EXERCISE  No.  2 

We  have  here  a  figure  exercise  very  much  like  the  one  that  we  gave  you  some  time  ago,  but 
now  we  will  give  you  much  more  time.  We  do  not  want  you  to  work  as  fast  as  you  can,  but  we 
want  you  to  be  sure  to  get  every  exercise  right. 

B  CD 


(f 


5 a      a 


<&^y>   \     &   £t>    1b 


1 


Look  at  Figure  1.  It  is  made  up  of  Figure  A,  and  one  of  the  figures  B,  C,  and  D  shown  at 
the  top.  Which  figure  at  the  top,  together  with  Figure  A,  will  make  Figure  1  ?  Yes,  Figure  B 
and  Figure  A  together  will  make  Figure  1.  Write  the  capital  letter  B  on  the  dotted  line  just  to  the 
left  of  Figure  A. 

Now  I  want  you  to  draw  a  line  in  Figure  1  so  that  it  cuts  Figure  1  up  into  Figures  A  and  B. 
Draw  the  line  now  Does  either  of  these  two  parts  need  to  be  turned  over  in  order  to  make 
Figure  A  or  Figure  B?  Neither  part  needs  to  be  turned  over,  so  I  want  you  to  write  the  num- 
ber 0  just  above  Figure  1.  (Illustrate,  with  figure,  on  blackboard.)  The  0  means  that  no  part 
needs  to  be  turned  over. 

Look  at  Figure  2  and  draw  a  line  in  it  so  that  it  makes  Figures  A  and  B.  Look  carefully. 
Does  the  left-hand  part  need  to  be  turned  over  to  make  Figure  A?  Yes,  it  does.  Does  the 
right-hand  part  need  to  be  turned  over  to  make  Figure  B?  No,  it  does  not,  so  in  Figure  2 
there  is  one  part  that  must  be  turned  over.  You  are  therefore  to  make  the  number  1  just  above 
Figure  2. 

Look  at  Figure  3.  When  a  line  is  drawn  cutting  it  into  the  two  figures,  do  either  of  these 
parts  have  to  be  turned  over  to  make  Figure  A  or  Figure  B?  No,  so  you  will  write  0  just  above 
Figure  3. 

Now,  look  at  Figure  4,  and  draw  a  line  properly  cutting  it  into  two  parts  and  write  the 
number  showing  the  number  of  parts  that  must  be  turned  over.  What  number  did  you  write? 
"2"  is  correct,  for  both  parts  must  be  turned  over  before  they  will  exactly  fit  upon  Figures 
A  and  B. 

Do  Figures  5  and  6  in  the  same  way.  (Give  individual  assistance  where  necessary.)  You 
should  have  written  1  just  above  Figure  5  and  1  just  above  Figure  6,  so  that  the  numbers  written 
in  by  you  should  now  read-  0,  1,  0,  2,  1,  1.    How  many  have  them  all  right? 


.     A 

■  b 

■  b 
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^] 


Ca 
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(For  directions  see  Form  A,  page  1) 

READING  EXERCISE 

ON  THE  FARM 

One  day  Walter  and  his  younger  (brother,  sister)  Helen  went  to  visit  their  Grandpa's  big 
(farm,  city)  They  were  very  happy,  for  they  knew  that  they  would  have  a  (cold.-fine)  time.  When 
they  got  there,  Grandma  kissed  them  and  gave  them  each  a  (cookie,  whipping),  saying,  "Now  go  and 
play,  children."  On  the  farm  there  were  many  cows  (but,  and)  horses.  There  was  also  a  small  brook 
which  (stood,  ran)  tumbling  along  over  the  rocks  down  in  the  (road,  meadow).  At  one 
place  the  brook  grew  (wider,  taller)  and  became  a  little  pool  where  many  ducks  and  geese  were 
(swimming,  walking)  about.  Walter's  Grandpa  also  had  chickens  and  turkeys,  but  of  course  they 
could  not  (swim,  walk)  like  the  ducks.  Back  of  the  brdok  were  some  apple  (vines,  trees).  Walter 
stood  on  his  tiptoes  to  reach  for  a  branch  and  pick  an  (acorn,  apple).  When  Helen  saw  what  he  was 
doing  she  said,  "(Walter,  James),  do  not  pick  that  because  it  is  green  and  not  good  to  (cook,  eat)." 
They  soon  found  two  ripe  (red  white)  apples,  and  they  ate  these  because  they  were  hungry  in  spite 
of  having  had  a  (cookie,  sandwich).  How  good  they  tasted!  Then  Walter  wanted  to  see  what  was 
inside  of  the  big  red  (ship,  barn)  which  was  near  the  back  of  the  house;  so  he  and  Helen  went  through 
the  wide  (world,  doors)  and  climbed  up  a  tall  ladder  to  the  top  floor  of  the  (house,  barn).  Every- 
where they  looked  were  great  piles  of  hay  for  feeding  the  horses  and  (cattle,  camels).  In  one  corner 
they  heard  a  strange  (sight,  noise).  When  they  looked,  they  saw  a  big  brown  bird  with  staring 
(wings,  eyes).  Helen  was  afraid,  but  Walter  shouted  boldly,  and  the  large  (bird,  cat)  flew  to  the  top 
of  the  barn.  When  the  (children,  boys)  told  Grandma  about  the  bird  they  saw,  she  said  it  was  a' 
(brown,  white)  owl. 

Then  Grandma  told  (Tom,  them)  to  go  out  to  the  little  house  built  for  the  dog  and  .(see,  ask) 
what  they  would  find.  The  children  had  often  played  with  Flossie,  the  lovely  shepherd  (dog,  lamb), 
when  visiting  the  farm,  and  so  were  delighted  to  pay  her  a  (dollar,  visit)  in  her  own  little  house.  But 
when  they  reached  it  they  found  not  only  (Bessie,  Flossie),  but  six  wee  black  puppies  which  were 
scrambling  (at,  over)  their  mother  and  over  each  other.  With  their  bright  eyes  and  little  noses, 
they  (are,  were)  doing  their  best  to  learn  all  about  the  strange  world  in  which  (they,  we)  lived. 

Flossie  at  first  seemed  a  little  doubtful  about  (asking,  letting)  the  children  handle  her  babies, 
but  when  she  saw  how  (gentle,  brutal)  the  children  were,  and  felt,  as  dogs  do,  that  there  was 
(no,  only)  love  in  their  feeling  for  the  puppies,  she  let  the  children  pick  (apples,  them)  up  and  pet 
them. 

Then  Walter  and  (Constance,  Helen)  asked  if  they  might  go  down  to  (sail,  wade)  in 
the  brook,  and  Grandma  gave  them  a  towel  with  which  to  wipe  their  feet  when  they  finished 
(swimming,  wading).  The  water  was  very  (shallow,  rough),  and  not  very  cold,  and  the  children 
saw  some  little  fishes  which  would  later  grow  (big,  small)  and  would  find  their  way  to  the  deep  river 
into  which  the  (ocean,  brook)  emptied.  They  found,  also,  some  funny  long-tailed  tadpoles  which 
would  later  lose  their  tails  and  become  (green,  yellow)  frogs,  and  would  hop  about  on  dry  land  as 
joyfully  as  they  now  (hopped,  played)  about  in  the  water. 

The  children  were  so  interested  in  the  many  kinds  of  (life,  sea-shells)  which  they  found  in  the 
water  that  they  were  greatly  surprised  when  they  (saw,  heard)  the  deep  tones  of  the  big  bell  call- 
ing all  the  people  on  the  (boat,  farm)  to  come  to  the  midday  dinner.  They  then  found  that  they  were 
as  hungry  as  Flossie's  (chickens,  puppies)  and  scampered  back  to  the  (barn,  house). 

Go  right  on  to  the  next  story  and  do  the  same  thing. 
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INDIANS 

Have  you  ever  seen  a  real,  live  Indian?  Surely  some  of  you  (went,  have)  and  all  of  you  have 
seen  pictures  of  them,  and  have  (heard,  seen)  them  in  the  movies. 

Not  so  many  years  (ago,  ahead)  there  was  not  a  white  person  in  this  whole  land  of  ours.  There 
were  only  (black-skinned,  red-skinned)  Indians  who  wandered  from  place  to  place,  living  by  hunting 
with  a  bow  and  (gun,  arrow),  and  fishing  with  hooks  made  of  bone.  The  skins  of  the  animals  which 
(they,  we)  killed  were  made  into  clothing  and  into  tents  to  live  (in,  with).  But  most  of  the  Indians 
have  gone,  and  now  we  do  not  see  many  (in,  of)  them,  except  in  the  circus  where  they  ride 
(trains,  horses)  at  a  great  speed. 

In  the  southwest  part  of  the  United  (people,  States)  there  are  still  a  good  many  Indians  left 
Here  it  is  very  (hot,  dark)  and  sandy,  and  it  is  not  easy  to  get  water.  The  sun  shines  nearly  every 
(day,  night)  in  the  year.  There  are  not  many  fish  and  wild  animals,  so  the  (Japanese,  Indians) 
have  learned  to  plant  and  grow  a  little  corn.  When  this  (corn,  wheat)  has  grown  they  grind  it  and 
make  it  into  large  flat  cakes,  and  then  bake  these  cakes  on  (hot,  cold)  stones.  The  houses  of  the 
Indians  are  made  of  stone  and  mud  with  (empty,  flat)  roofs  and  small  doors,  and  frequently  one  house 
is  built  right  on  top  of  another.  In  this  case  the  Indians  must  climb  (down,  up)  a  ladder  to  get  to  their 
homes.  Inside  the  rooms  there  are  bright  rugs  which  the  Indians  themselves  have  (made,  found). 
There  are  also  strong  jars  of  clay,  made  hard  by  baking  in  the  (river,  fire)  and  baskets  woven  of 
grass  so  tightly  that  water  can  be  carried  (on,  in)  them.  This  country  is  so  dry  that  there  is  very 
little  (water,  sunshine)  and  it  must  frequently  be  carried  a  long  way  and  kept  for  a  long  time.  That 
is  why  these  Indians  have  learned  to  (buy,  make)  their  jars  and  baskets  so  strong. 

Years  ago  these  Indians  were  known  as  bold  fighters,  but  now  they  do  not  (fight,  eat)  any  more. 
They  are  much  happier  staying  at  home  in  their  strange  houses  and  (listening,  talking)  to  old  tales. 

As  the  tribes  steadily  decrease  in  (wages,  numbers)  and  are  forced  to  live  far  from  their 
(former,  future)  homes,  their  customs  and  arts  are  passing  (against,  from)  memory.  The  art  of 
making  the  beautiful  baskets  and  (china,  blankets)  may  soon  be  forgotten.  Some  of  the  Indians  are  so 
poor  that  they  cannot  now  (own,  sell)  sheep.  Sometimes  the  women  go  far  out  on  the  (ocean,  ranges) 
and  gather  small  pieces  of  wool  from  the  thorny  shrubs  which  have  torn  it  from  the  (cattle,  sheep)  as 
they  passed.  In  former  days  the  wool  was  colored  with  vegetable  (dyes,  paint)  which  did  not  injure 
it.  Now  they  frequently  use  poor  dyes,  which  fade  and  the  blankets  are  (often,  never)  poorly  made. 

The  Indians  have  many  beautiful  songs  which  were  never  written  down  but  have  (lived,  died) 
only  in  their  memories.  Some  of-  these  have  quite  recently  been  written  and  printed  by  our  own 
(carpenters,  musicians).  Some  are  hymns  which  were  sung  at  daybreak  to  greet  the  (setting,  rising) 
sun,  and  some  are  lullabies  which  put  the  (Japanese,  Indian)  babies  to  sleep.  The  Indian  mother  be- 
lieves that  when  her  child  (goes,  refuses)  to  sleep  its  soul  passes  into  another  world  which  is  guarded 
by  the  spirits  of  the  moon  and  the  planets  (and,  in)  the  stars.  So  the  mother  prays  to  these  spirits 
to  guard  and  instruct  her  (child,  mind)  while  it  is  in  their  care. 
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2 
6 

7 
4 

8 
7 

9 
6 

3 
7 
9 

8 
5 
2 

4 
3 
7 

5 
4 
9 

8,10 

11,  13 

20,  15 

15,17 

19,21 

12,  15 

14,16 

16,18 

Add- 

6 
2 
6 

7 
9 
3 

8 
5 
9 

2 
9 

7 

5 
8 
8 

7 
4 
8 

9 
9 
6 

26, 24 

8 
9 

7 

14,16 

19,21 

22,24 

20;  18 

23,21 

19, 18 

24,25 

Subtract : 

12 
6 

15 

5 

17 
8 

18 
7 

13 
4 

19 

5 

14 
7 

16 
9 

6,8 

10,5 

9,11 

8,11 

9,7 

14,12 

9,7 

7,5 

Subtract: 

16 
8 

12 

7 

14 
5 

11 

8 

15 
3 

18 
9 

19 
6 

19 

8 

6,8 

3,5 

9,8 

3,4 

11,12 

9,11 

11,13 

11,9 

Multiply: 

5X2=10, 

15 

3X5  = 

=  17, 

,  15 

4X2  = 

=  6,  8 

3X3  = 

-9,  12 

Multiply. 

3X2  =  8, 

6 

4X3  = 

:12: 

,  14 

5X4  = 

=  20,  25 

5X5  = 

=  15,  25 

Divide: 

8-2  =  4, 

2 

4-2  = 

=  1, 

2 

6-3  = 

=  2,  3 

8-4  = 

=  4.  2 

Divide: 

10-2  =  5, 

2 

6-2  = 

3, 

2 

9-3  = 

=  5,  3 

10-5  = 

=  3,  2 

Add: 

2 

7 
5 
3 

4 
2 
8 
2 

7 
6 
4 
3 

8 
5 
6 

7 

2 
9 

8 

4 

5 
8 
6 
6 

2 
9 
5 
7 

3 

5 
7 
8 

17,19  17,16  20,  IS  26,28 

Go  right  on  with  the  problems  on  page  5. 


25,23  24,25  23.25  23,27 
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Add: 

7 
8 
5 
9 

2( 

2 
7 
3 
8 

6                    5 
5                    2 
8                    9 
3                    8 

7 
4 
8 
4 

9 
8 
7 
6 

9                   8 
9                   9 
8                    9 

4                    7 

27,29 

).22 

24, 22             28, 24 

23,21 

30,33 

29,  30             35, 33 

Subtract: 

20 
12 

29 
14 

23                  28 
18                   13 

22 
19 

24 
15 

28                  27 
16                   14 

8,6 

15,13 

7,5               15.17 

3,4 

9,8 

12, 14              15,  13 

Subtract: 

22 
17 

25 
12 

23                   21 
15                   11 

26 
17 

27 
18 

26                  29 
19                   16 

7,5 

13,15 

7, 8                9, 10 

9,7 

11,9 

5,7                17,13 

Multiply: 

2X6=16, 

12 

5X2=10,  S 

3X5  = 

15,  10 

4X3  =  8,  12 

Multiply: 

3X7  =  21, 

18 

3X6=19,  18 

8X4  = 

32,  36 

9X5  =  45,  54 

Divide: 

15  +  3  =  5, 

4 

16-4  =  4,  6 

12  +  3  = 

=  3,  4 

18  +  9  =  2,  3 

Divide: 

20  +  2=10 

,  5 

14  +  7  =  2,  6 

16  +  8  = 

=  4,  2 

18  +  3  =  6,  7 

Multiply: 

8X6  =  56, 

48 

6X7  =  42,  49 

8X8  = 

68,  64 

6X6  =  36,  39 

Multiply: 

9X6  =  45, 

54 

7X9  =  69,  63 

7X8  = 

56,  57 

8X9  =  78,  72 

Divide. 

45+15  =  3 

,  6 

36+18  =  5,  2 

33  +  11 

=  3,  6 

40+10=5,  4 

Divide: 

48  +  16  =  4 

,  3 

32  +  16  =  3.  2 

42+14 

=  2,  3 

34+17  =  4,  2 
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Go  right  on  to  the  next  page. 
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Name. 


on 

• 

do  *           *  be 

do* 

be 
* 

*on 

an 

* 

he  *           *  so 

as 

* 
be* 

*at 

is 

* 
or  *           *  us 

to  *                *  my 

no* 

2       *as 

at  *       3       *  UP 

he*       4 

*is 

do*       5       *a' 

go*           *an 
* 
it 

he* 

*or 

* 
we 

am* 

i 

d 

♦  it 

0 

to* 

* 

go 

*of 

am*           *it 

* 
as 

°*  *   *oo 

O. 

?*s> 

□ 

ffl 

,S 

0.9*13) 

a*    6   *ffl 
*  *     * 
A   6P 

8* 
EB* 

7   *A 
*    oo 

[ — 1  v>^ 

a*   8    *Q 

*     • 

00  Ap 

O*     9 

•3> 

*£7 

<?*    to  *^ 

2 

3*          *9 

7*      11      *5 

8*          *6 

* 
4 

6* 
8* 
9* 

2 

* 
*7 

12     *4 

*5 

* 

3 

3 

6*          *2 
4*      13      *7 

5*          *9 

* 
8 

3 

* 
2* 

6*    14 

9* 

* 

8 

*7 

*5 
*4 

5 

9*    *    *7 

2*      15     *3 

6*          *8 

* 

4 

***** 

< 

3*    *   *^ 

"if*    * 

.* 

*.*.» 

.  *        • 

\7     *? 

3L*    19 

^*    20    *dl 

«  A"0 

go 

or 

be 

so 

if*          *of 
my*      21      *u 

we  *          *  no 

* 
am 

p 

my* 

so*    22 

no* 

* 
is 

*on 
*if 
*us 

an  *          *  to 
it  *      23      * so 

in  *           *  if 

* 
us 

11 

he*           *as 
p*      24      *we 

or*           *of 

* 
on 

DESCRIPTION,   SCORING,   AND   RELIABILITY 


187 


FORM  B 
Memory  Tests  (Page  2) 


r,  ®  n 

a°,p 

Pj.B 

?    A 

&S& 

O*    25    +  & 

*            * 

A 

O*   26    *0 

*               * 

A*    28    *Z7 

g>*  29  ♦■& 

72 

32 

92 

75 

88 

25*         *39 

77*     30     *87 

29*         *34 

90*          *70 

64*     31      *12 

22*          *38 

35*          *86 
79*     32     *42 

23*          .98 

18*          *13 

50*     33     *51 

94*          *21 

95*  .47 
45*     34     *71 

69*          .26 

82 

80 

55 

37 

84 

**     "7-      A 

*.*> 

+[*    35    *-€\ 

7* 

^*    37    *^- 
7- 

^-*     38    *+( 
<** 

^7*     39    *<? 

j*        * 

^4* 

who 

law 

and 

new 

off*           *hot 
can  *      40      * our 

any  *           *  was 

*        , 
war*           *Iet 

out  *    41    *  y°u 

son*           *old 

die  *           *  sit 
had  *      42      *  to° 

law*           *her 

may  *           *  too 

buy  *      43      * use 

for  *           *  hot 

ask 

her 

yet 

ask 

•             * 

o  _ 

0*°*2 

vS& 

P^  A 

'*            * 

8.    44    *<? 

0*    45    *£j 

O*    46    *<& 

Q*    A7    *•& 

J*    48    *0 

&ka 

aVa 

6 

A*    •   *7 
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145 

288 

884 

829 

873 

597*         *764 

740*          *360 

336*          *249 

945*          *388 

521*          *412 

502*      49      *  31 1  1 

93*     50      *907 

788*     51     *140 

497*     52      *72J 

170*     53     *735 

954*          *859 

645*          *455 

241*          *115 

146*          *537 

818*          *927 

407 

550 

958 

794 

467 

*A* 

\\*A 

K?** 

H^ 

/3*   54     *tf 

y?*   55  *^ 

$.*    56    *^ 

tf*     57   *^ 

^n.*   5  8     *& 

*        *. 
*.    *     to 

"0 

*      * , 

NO        *        itC 

***/* 

*        * 

J  si  * 

read 

* 

mean  *           *  word 

draw 

* 

show*           *name 

care 
* 
life  *           •  keep 

true 

* 

love  *           *  have 

than  *      59      *  caM 

soft  *      60      *  came 

hold  *     61     *  y°ur 

then  *      62      * nee^ 

good  *           *  last 

know  *           *  free 

sure*           *made 

seem  *           *  take 

* 
must 

* 
best 

* 
been 

* 
help 

A.*.* 

).?•* 

a  ^  & 

°Ss? 

□  +     63    *<v 

>D*    64    *^? 

A*    65    *0 

oo*    66    *o 

D»     67   »ffl 

A*    *    *c^ 

er^m 

CD 

n*6> 

tf6*A 

*    -ft 

+.*.* 

«.*.n 

**> 

&*    68    *-J 

Jiff*     69    *^- 

£f*    70    *oJ 

|±*     71       *"V 

>(*     72   *£, 

*       * 

.*          * 

*        * 
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story 

along 

given 

often 

money  *           *  begin 

alone*           *  until 

never  *           *  happy 

story  *           *  heavy 

after*      73      *  again 

story*      74      *  order 

today*      75      *  after 

•  money*      76      *  being 

carry*           *  until 

often  *           *  today 

carry*           *  order 

after  *           *  happy 

early 

money 

being 

visit 

e-^A 

A,£»EB 

A 

o 

■ft*    77    *Z7 

O*    76    ^ 

O*    79   *a 

oo*   80   *A 

A*    81     *fl) 

fflV* 

ft 

<?VA 

a*  *b 

CD 

tfpe 

A?  *    /D 

'  *      *  w 

^ 

<^*^ 

^t/ 

♦.*.« 

^*    82    *-£ 

v>(\*    83    *X 

^*    8^    *X 

■£-*    85    *? 

A*    86    *J 

*7   *  -ir 

/a 

.  *       * 

0> 

^♦/A 

*        * 

V^£ 

o   £* 

E$*A 

A    „ 

A*  87  *o 

oo*    68    *P 

O*    89    *0 

P*    90    *<& 

O*     91     *  O 

*        * 

8  £  °° 

^ffl^ 

o.* 

*;*** 

*.~* 

V    92    *^ 

W.  93  *me 

j£*    94    *^J 

2£*   95     *■£" 

£?*    96    *n& 

ryi 

■  *        *_i 

*        *, 

*!** 

?> 
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>  A 

■  A 

-  Do 


^   ^    Q=> 


1? 


h  z? 

^>  fib 


<qt>  £k    HI  rf   (^ 


"^^p 


CHAPTER  IX 

MENTAL  FACTORS  REVEALED  IN  PUBLISHED 
STUDIES 

Considering  the  universality  with  which  psychological  workers 
calculate  correlation  coefficients  one  would  suppose  that  a  large 
amount  of  data  would  be  available  in  the  literature  for  study  by 
the  methods  here  utilized.  This,  however,  is  not  the  case,  because 
there  are  many  requirements  that  need  to  be  met  before  the  data 
are  valuable  for  the  purpose  of  differentiating  between  abilities. 
It  is  highly  desirable  that  the  following  conditions  hold : 

a)  The  population  studied  should  be  large.  A  reference  to  the 
formulas  giving  the  probable  errors  of  tetrad  differences  and  of 
pentad  functions  shows  the  necessity  of  this.  The  writer  con- 
siders that  practically  none  of  the  data  provided  by  Spearman  and 
his  students  is  amenable  to  the  pentad  function  method  or  the 
more  detailed  methods  of  treatment  herein  presented,  because  of 
the  small  populations  dealt  with.  It  is  of  course  true  that  these 
studies  were  made  before  the  probable  error  formulas  in  question 
were  available.  Had  they  been  available,  Spearman  would  un- 
doubtedly have  worked  with  larger  populations.  If  one  assumes 
one  single  factor  to  be  adequate  in  the  explanation  of  a  given  set 
of  inter-correlations,  obviously  the  smaller  the  population  the  more 
likely  are  the  data  to  be  consistent  with  the  assumption.  It  seems 
to  the  writer  that  Spearman's  analyses  have  been  largely  affected 
by  this  kind  of  situation.  The  present  writer's  failure  to  analyze 
in  detail  the  many  published  correlation  tables  of  Spearman  and 
his  students  is  not  due  to  unfamiliarity  with  them,  for  many  of 
these  studies  have  been  carefully  examined  and  found  wanting  for 
the  present  purpose  because  of  the  small  populations  involved,  and 
because  of  failure  to  meet  desideratum  (b)  given  in  the  next  para- 
graph. 

b)  The  population  should  be  as  homogeneous  as  possible  from 
the  standpoint  of  general  maturity,  race,  sex,  and  general  scho- 
lastic training,  otherwise  any  general  factor  found  will  be  due  in 
whole  or  in  part  to  maturity,  etc. 
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c)  The  measurements  employed  should  be  defined  in  terms  of 
objective  scores  on  designated  tasks.  Teachers'  judgments  or  other 
subjective  scoring  schemes  cannot  be  tolerated  in  this  connection, 
because  of  the  impossibility  of  objectively  defining  a  function 
which  is  so  measured. 

d)  The  measurements  employed  should  be  of  fairly  discrete 
mental  traits,  for  a  measure  involving,  let  us  say,  both  reading  and 
arithmetic  will  not  enable  us  to  differentiate  between  these  two 
abilities.  We  thereby  lose  the  possibility  of  studying  the  very 
issue  that  concerns  us.  Not  infrequently  fairly  discrete  tests  have 
been  given  to  subjects,  but  in  reporting  results  omnibus  scores 
only,  generally  sums  or  averages,  have  been  recorded. 

e)  The  separate  measures  employed  should  have  high  reliabili- 
ties. A  test  like  the  National  Intelligence  Test  or  like  Army  Alpha 
can  be  split  up  into  several  sub-tests,  but  the  reliabilities  of  these 
sub-tests  are  very  low.  We  accordingly  cannot  use  the  sub-tests  on 
account  of  low  reliability  nor  the  total  test  score  on  account  of  the 
complexity  of  the  function  measured. 

/)   It  is  necessary  that  many  variables  be  studied  at  a  time. 

In  spite  of  the  very  general  inappropriateness  of  the  correlation 
data  ordinarily  published,  it  has  seemed  worth  while  to  report  on 
some  of  the  most  promising  of  the  extant  data. 

In  this  connection  we  may  use  the  very  carefully  reported 
study  of  Dr.  Rose  G.  Anderson  (1925).  Her  study  has  the  fol- 
lowing characteristics :  (a)  The  population  studied  is  large,  being 
382.  (b)  The  population  is  homogeneous  in  the  matter  of  age,  as 
all  the  subjects  were  thirteen  years  old.  It  is  heterogeneous  in  the 
matter  of  sex,  and  it  is  to  be  presumed  in  the  matter  of  race. 

(c)  All  measurements  are  clearly  defined  in  terms  of  specific  tests. 

(d)  A  hasty  examination  of  the  various  tests  suggests  that  they 
are  not  at  all  discrete  one  from  another.  It  was  not  Dr.  Ander- 
son's purpose  that  they  should  be.  (c)  The  reliabilities  of  the 
separate  tests  must  be  rather  low,  as  the  reliability  of  the  total 
battery  is  only  .93  and  the  range  of  talent  wide.  (/)  The  number 
of  variables  studied  is  sixteen,  which  would  be  considered  excep- 
tionally adequate  were  it  not  for  the  fact  that  many  of  the  tests 
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measure  nearly  identical  capacities.  In  spite  of  the  shortcomings 
of  these  data  they  seem  to  the  writer  to  be  the  most  adequate  of 
any  that  have  been  found  in  the  psychological  literature.  The 
variables  involved  are  as  follows : 

1.  A  letter-number-substitution  test. 

2.  A  test  involving  the  selection  of  a  pair  of  opposites  of  words. 

3.  A  test  involving  the  selection  of  three  co-ordinates  of  words. 

4.  A  test  involving  the  designation  of  a  word  as  a  subordinate. 

5.  A  test  involving  the  selection  of  the  one  of  five  words  not 

co-ordinate  with  the  other  four. 

6.  A  verbal-directions  test  based  on  the  alphabet. 

7.  A  directions  test  involving  the  perception  of  separate  letters 

in  verbal  material  and  reaction  with  a  number. 

8.  A  computation  test  involving  the  designation  of  the  opera- 

tions needed  to  obtain  a  given  answer. 

9.  A  verbal  test  involving  the  designation  of  predicates. 

10.  A  directions  test  involving  geometrical  figures  and  the  un- 

derstanding of  verbal  statements  concerning  the  same. 

11.  A  number-series  test. 

12.  A  test  involving  elementary  computation  and  following  of 

directions. 

13.  A  test  involving  the  perception  and  retention  over  a  short 

interval  of  the  letters  contained  in  words. 

14.  An  arithmetic-reasoning  test. 

15.  A  disarranged-sentences  test. 

16.  A  test  involving  the  supplying  of  a  missing  number  in  an 

arithmetic  operation. 

The  reader  is  directed  to  the  original  monograph  for  more 
detailed  descriptions  of  these  tests  and  for  the  basic  table  of  inter- 
correlations.  Every  test  was  correlated  with  every  other  and  with 
the  criterion.  Using  these  inter-correlations  by  a  method  prac- 
tically the  same  as  that  described  on  pages  199-200,  it  was  ascer- 
tained that  a  number  of  the  tests  measured  substantially  the 
same  function.  Such  tests  have  been  combined  into  single  vari- 
ables by  the  present  writer  yielding  eight  variables  whose  inter- 
correlations  are  given  in  Table  XXXVII. 
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TABLE  XXXVII 
Inter-correlations  for  Population  of  382  Thirteen-Year-Olds 


"Variables 

l 

2 

3 

4 

5 

6 

7 

8 

1 

2 

.4527 

3 

.4058 

.5319 

4 

.3193 

.4108 

.3961 

5 

•  3704 

.4171 

.5311 

.4980 

6 

.5267 

.6499 

.6255 

.4410 

.6406 

7 

.5251 

•  5275 

.5417 

.4264 

.6501 

.6786 

8 

•  5124 

.4800 

.5436 

.2968 

.5367 

.5722 

•  6265 

The  variables  of  this  table  are  related  to  those  in  Dr.  Ander- 
son's monograph  as  follows : 

VARIABLE   TABLE 
ABBREVIATED    TITLE  XXXVII  DR.   ANDERSON'S  VARIABLE 

Letter-number  substitution 1  1 

Directions — Verbal    2  6 

Directions — Verbal  and  Number 3  7 

Directions — Geometrical  and  Verbal 4  10 

Arithmetic  Reasoning 5  14 

Verbal 6  Equally  weighted  average 

of  Nos.  2,  3,  4,  9,  and  IS 
Correction  of   imperfect  and  incomplete 

texts    7  Equally  weighted  average 

of  Nos.  8,  11,  and  13 
Numbers      test,      involving     elementary 
computation  and  the  correction  of  in- 
complete operations  in  elementary  com- 
putation         8  Equally  weighted  average 

of  Nos.  12  and  16 

From  the  correlations  of  these  eight  variables,  given  in 
Table  XXXVII,  tetrad  differences  were  determined.  The  tetrad 
differences  coming  from  Table  XXXVII  were  credited  to  bonds 
which  could  conceivably  have  given  rise  to  them  as  indicated  in 
Table  XXXVIII. 
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In  view  of  the  none  too  satisfactory  nature  of  the  data  involved, 
it  hardly  seemed  warranted  to  spend  the  time  that  would  be  re- 
quired to  determine  the  most  reasonable  factor  values  for  each  of 
the  variables.  We  thus  concern  ourselves  with  the  first  step  only, 
(a),  of  chapter  iii,  page  80,  and  in  fact  will  not  do  more  than 
locate  the  variables  in  pairs  between  which  lie  special  bonds.  The 
procedure  is  that  involved  in  chapter  iii,  pages  72-75. 

In  order  to  interpret  the  data  of  Table  XXXVIII  we  need  at 
least  a  rough  idea  of  the  size  of  the  probable  error  of  the  mean 
tetrad  differences.  Having  this  we  may  then  attempt  to  pick  out 
pairs  of  variables  between  which  lie  a  special  bond.  Two  standard 
errors  have  been  calculated  as  explained  in  chapter  iii.  The  mean 
of  the  tetrad  differences  involving  variables  x5  and  x7  is  .03  and  its 
standard  error  is  .015.  Assuming  standard  errors  of  the  same 
general  order  for  the  other  mean  tetrad  differences,  we  find  some 
eleven  situations  in  which  the  mean  tetrad  difference  is  more 
than  two  times  its  probable  error.  Let  us  seek  for  an  explanation 
of  these  situations : 

The  mean  tetrad  difference  involving  variables  x±  and  x5  is  .07. 
The  nature  of  the  special  bond  that  is  operative  here  is  very 
obscure,  but  it  apparently  has  something  to  do  with  the  following 
of  directions. 

The  mean  tA  8  *  j  =  -.07.  It  is  quite  probable  that  three  small 
negative  bonds,  verbal,  spatial,  and  numerical,  combine  to  give  this 
fairly  large  negative  value. 

The  mean  t2Bi  i  =  -.07.  This  is  probably  due  to  a  negative 
numerical  bond. 

The  mean  t1 5 » y  =  -.06.  This  is  probably  due  to  a  negative 
verbal  and  numerical  bond. 

The  mean  t18t  j  =  .05.  This  is  probably  due  jointly  to  a  nu- 
merical and  a  memory  bond. 

The  mean  t2  6  *  j  =  -04,  and  the  mean  f2  4  <  j  =  .03.  These  may 
both  be  due  to  verbal  bonds. 

The  mean  1 8  7  %  j  =  -.03.   The  cause  of  this  is  quite  uncertain. 

The  mean  f5  7  ,•  ,  =  .03.  This  is  probably  due  to  a  numerical 
bond. 
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The  mean  t6  s  i  j  =  -.03.  This  may  well  be  due  to  a  negative 
verbal  bond. 

The  mean  tj  8  *  f  ==  .03.  It  is  likely  that  this  is  due  to  a  numeri- 
cal bond. 

Though  the  results  of  our  analysis  of  Dr.  Anderson's  data  are 
generally  corroborative  of  the  findings  earlier  reported,  there  are 
still  one  or  two  bonds  suggested  for  which  we  can  offer  no  very 
probable  explanation. 

The  next  several  reports  upon  other  studies  which  are  given 
herewith  are  modifications  of  class  papers  presented  by  the  stu- 
dents mentioned. 

Mr.  J.  W.  Dunlap  examined  the  data  provided  by  Dr.  Her- 
bert A.  Toops  in  "Tests  of  Vocational  Fitness  of  Children"  (1921), 
with  the  following  results. 

Cases  studied :  44  boys  of  age  fourteen. 

Tests  given : 

1.  Manual  training 

2.  Stenquist  Assembly 

3.  Stenquist  Picture  Completion,  No.  1 

4.  Stenquist  Picture  Completion,  No.  2 

5.  General  Trade  Test 

6.  Mechanical  Interest  Test 


TABLE  XXXIX 
Table  of  Raw  Correlations 


Test 

l 

2 

3 

4 

5 

6 

1.  Manual  Training  Test 

•  23 
.15 

.05 
.32 
.16 

•  60 

•  31 
.26 

.71 

—  02 

—  04 
.37 

.66 

2.  Stenquist  Assembly  Test 

3.  Stenquist  Picture  Com.,  No.  1 . . 

4.  Stenquist  Picture  Com.,  No.  2. . 

.52 

.25 

The  bonds  suggested  are  as  follows : 

a)   Stenquist  Picture  Completion  Test,  No.  1,  x3,  and  Picture 
Completion  Test,  No.  2,  x4.   The  only  obvious  difference  between 


MENTAL  FACTORS  IN  PUBLISHED  STUDIES 


199 


TABLE  XL 

Summary  Table  of  Tetrad  Differences 


Variables 

No.  of  Positive 

Median  Tetrad 

Variables 

No.  of  Positive 

Median  Tetrad 

in  Pairs 

Tetrads 

When  Positive 

in  Pairs 

Tetrads 

When  Positive 

1,2 

6—1 

2,6.... 

6—1 

1,3 

6+0 

3,4.... 

6+6 

•  20 

1,4 

6-2 

3,5.... 

6—3 

1,5 

6+4 

.10 

3,6.... 

6—2 

1,6 

6—1 

4,5.... 

6—6 

2,3 

6+2 

.07 

4,6.... 

6+2 

.03 

2,4 

6+0 

5,6.... 

6+4 

.11 

2,5 

6+0 

these  two  tests  is  that  the  second  is  harder  than  the  first.  We  may 
therefore  look  upon  this  bond  as  due  to  specific  elements  in  the 
Picture  Completion  Tests  and  credit  the  bond  to  common  content. 

b)  Manual  Training  score,  xu  and  General  Trade  Test,  x5. 
Here  again  the  two  tests  are  very  similar  in  subject-matter,  so  that 
the  bond  may  be  looked  upon  as  due  to  knowledge  of  a  specific 
subject  (tools,  carpentry,  etc.). 

c)  There  are  bonds  between  the  General  Trade  Test,  x5)  and 
the  Mechanical  Interest  Test,  x6;  also  between  the  Stenquist  As- 
sembly Test,  x2,  and  the  Stenquist  Picture  Completion  Test,  .r3 ; 
and  finally  between  the  Stenquist  Picture  Completion  Test,  No.  2, 
x4,  and  the  Mechanical  Interest  Test,  x6.  As  with  reference  to  the 
other  bonds,  it  seems  reasonable  to  think  of  these  as  due  to  common 
subject-matter,  i.e.,  they  are  bonds  due  to  a  specific  content. 

Mr.  Herbert  Popenoe  has  examined  the  data  reported  by  Miss 
Francis  Gaw  in  "A  Study  of  Performance  Tests"  (1925). 

Subjects  tested:  52  boys  just  graduating  from  an  English 
elementary  school. 

Tests  employed  :  Miss  Gaw  gave  seventeen  tests,  but  because  of 
the  complexity  of  the  work  when  dealing  with  such  a  large  number 
of  variables,  and  because  of  the  small  population  tested,  this  num- 
ber has  here  been  reduced  to  eight.  These  eight  tests  were  selected 
by  dividing  the  average  inter-correlation  of  each  test  by  the  esti- 
mated reliability  coefficient  of  the  test  and  then  choosing  for  reten- 
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tion  those  tests  yielding  the  smallest  quotients.  This  process  tends 
to  select  the  tests  with  high  reliability  and  much  independence  of 
each  other.  A  brief  description  of  the  eight  tests  chosen  for  further 
study  is  given  herewith. 

1.  Binet. 

2.  Dearborn  Form  Board.  The  test  utilizes  a  form  board  con- 
taining six  different  types  of  figures  or  insets  of  simple  geometrical 
shapes.  In  arranging  the  insets,  there  are  numerous  different  com- 
binations possible.  The  subject  is  given  three  problems,  in  each 
of  which  he  must  work  out  the  minimum  rearrangement  of  the 
blocks  inside  the  board  necessary  to  make  room  for  one  or  more 
blocks  outside  the  board.  Scoring  is  based  on  time  and  on  number 
of  moves. 

3.  Healy  Small  Form  Board  A,  the  recesses  of  which  are  to 
be  filled  with  blocks  of  various  geometrical  shapes.  Score  is  time 
taken. 

4.  Goddard  Adaptation  Board.  Oblong  board  through  which 
four  circular  holes  have  been  cut.  Three  are  6.8  cm.  in  diameter 
and  the  fourth  7.0  cm.  A  wooden  block  exactly  fits  the  larger 
hole.  Examiner  illustrates  that  block  will  fit  only  one  hole,  and 
then  turns  board  in  five  different  positions.  Scoring  is  number  of 
times  first  placing  of  block  by  subject  is  in  correct  hole. 

5.  Healy  Picture  Completion  Test,  No.  1.  Picture  of  12 
people  doing  various  things  in  an  outdoor  scene.  Ten  holes  have 
been  cut  in  the  picture,  removing  objects  essential  to  the  actions. 
Subject  is  given  a  collection  of  insets,  including  the  missing  objects 
and  some  others.    Score  is  number  of  places  filled  correctly. 

6.  Porteus  Maze  Test.  This  test  consists  of  seven  mazes,  graded 
in  order  of  difficulty  and  standardized.  Score  is  based  on  number 
of  mazes  passed  and  the  number  of  trials  necessary  for  success  at 
each  year. 

7.  Healy  Picture  Completion  Test,  No.  2.  This  test  is  similar 
to  No.  1,  except  that  it  is  more  difficult.   Scoring  is  as  in  No.  1. 

8.  Cube  Imitation  Test.  Four  black  cubes  are  placed  in  a  row 
before  the  subject,  and  with  a  fifth  cube  the  examiner  taps  the  four 
in  a  given  order.    There  are  twelve  such  patterns  of  increasing 
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difficulty,  which  the  subject  is  required  to  imitate  in  turn.   Scoring 
is  based  on  number  of  patterns  correctly  imitated. 

The  correlations  for  these  eight  tests  are  given  in  Table  XLI, 
and  the  summary  table  giving  data  upon  tetrad  differences  is  pre- 
sented in  Table  XLII. 


TABLE  XLI 

Inter-correlations   between   Tests   in   Population   of  52   Pupils 
Completing  the  Elementary  School 


1.  Binet  IQ 

2.  Dearborn  Form  Board.. 

3.  Healy  Form  Board  A. . . 

4.  Goddard  Adaptation 
Board 

5.  Healy    Picture    Comple- 
tion Test  No.  1 

6.  Porteus    Maze . , 

7.  Healy    Picture    Comple- 
tion Test  No.  2 

8.  Cube  Imitation  Test....        -27       .13 !      -27       .21       .031      .12       .22 


1 

2 

3 

—  01 

.08 

.05 

.32 

.10 

.29 

.18 

•  18 

—  05 

.52 

—.21 

.02 

•  57 

—.28 

.15 

.27 

.13 

•  27 

TABLE  XLII 

Summary  of  Tetrad  Differences  in  Population  of  52  Pupils 
Completing  the  Elementary  School 


Variables 
in  Pairs 


No.  of  Positive 
Tetrads 


Value  of 

Median  Tetrad 

Variables 

if  Positive 

in  Pairs 

•  01 

3,5.... 

3,6.... 

.02 

3,7.... 

3,8.... 

.07 

4,5.... 

.02 

4,6.... 

4,7.... 

.01 

4,8.... 

5,6.... 

.04 

5,7.... 

5,8.... 

6,7.... 

•  03 

6,8.... 

7,8.... 

No.  of  Positive 
Tetrads 


Value  of 

Median  Tetrad 
if  Positive 


1,2 
1,3 

1,4 
1,5 
1,6 
1,7 
1.8 
2,3 
2,4 
2,5 
2,6 
2,7 
2,8 
3,4 


15+1 
15—2 

15+4 

15—8 

15+10 

15+2 

15—7 

15+6 

15—5 

15+7 

15—8 

15—8 

15+6 

15—3 


15—7 
15—1 
15+3 
15+5 
15+2 
15—8 
15+7 
15+3 
15+4 
15+3 
15—1 
15+1 
15+2 
15—8 


•  01 
.03 
.00 

.04 
.01 
.01 

•  01 

•  01 

•  01 
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The  standard  error  of  the  mean  tetrad  t2  5  i  j  is  .031.  With 
this  value  as  a  cue  to  the  probable  errors  involved,  let  us  examine 
the  bonds  that  are  suggested.  There  seems  to  be  a  bond  between 
the  Binet  IQ,  xx,  and  the  Porteus  Maze  Test,  x6.  In  view  of  the 
heterogeneous  material  entering  into  the  Binet  Test,  it  seems  quite 
impossible  to  suggest  the  nature  of  this  bond. 

There  may  possibly  be  a  bond  between  the  Dearborn  Form 
Board  score,  x2,  and  the  Healy  Picture  Completion  Test,  No.  1,  x5. 
A  similar  motor  manipulation  is  involved  in  each  of  these. 

There  may  also  be  a  spatial  factor  leading  to  the  slight  x2xa 
bond.  A  slight  negative  spatial  factor  may  account  for  the 
x3x5  bond.  The  score  on  the  Dearborn  Form  Board  is  desig- 
nated x2,  that  on  the  Healy  Form  Board  A,  x3,  and  that  on  the 
Cube  Imitation  Test,  x8.  On  the  whole  the  inter-correlations  are 
very  low,  and  accordingly  the  probable  errors  are  large.  We  are 
not  justified  in  drawing  any  very  definite  conclusions  in  regard  to 
factors  whether  general,  special,  or  specific.  This  study  clearly 
illustrates  the  need  for  large  populations  and  reliable  scores,  for 
even  after  reducing  the  number  of  tests  from  seventeen  to  eight 
we  still  have  very  inconclusive  results. 

Miss  Gaw  provided  data  similar  to  that  just  reported  for  48 
girls  of  average  age  13.5.  The  raw  correlations  are  given  in 
Table  XLIII. 


TABLE  XLIII 

Inter-correlations  between  Tests  in  Population  of  48  Girls 
Completing  the  Elementary  School 


Test 


1.  Binet  IQ 

2.  Dearborn  Form  Board.. 

3.  Healy  Form  Board  A. . . 

4.  Goddard  Adaptation  Test 

5.  Healy    Picture    Comple- 
tion, No.  1 

6.  Porteus    Maze 

7.  Healy    Picture    Comple- 
tion, No.  2 

8.  Cube  Imitation  Test. . . . 


1 

2 

3 

4 

5 

6 

7 

—  .21 

—  10 

.05 

.35 

.10 

—  12 

.43 

—  .48 

—02 

.07 

.29 

.01 

—.04 

.12 

•  07 

.38 

.03 

.07 

.02 

.37 

.08 

.39 

—.24 

—.03 

.20 

.56 

•  42 

•  31 

s 
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These  data  were  examined  in  detail  with  negative  results.  There 
was  neither  confirmation  of  bonds  suggested  by  correlations  found 
in  the  case  of  the  boys,  nor  were  new  bonds  suggested  of  sufficient 
certainty  to  call  for  mention.  As  can  be  surmised  by  reference  to 
the  correlations,  the  probable  errors  present  are  so  large  as  to 
obscure  any  underlying  tendencies. 

Mr.  Edward  E.  Cureton  examined  the  data  provided  by  Agnes 
L.  Rogers  in  "Experimental  Tests  of  Mathematical  Ability  and 
Their  Prognostic  Value"  (1917). 

Subjects  tested :  61  girls  entering  high  school,  ages  from  12  years 
10  months  to  16  years  11  months,  and  having  a  mean  age  of  14.6. 

Tests  employed :  Seventeen  tests  were  employed  here,  but  the 
inter-correlations  of  eight  only  were  selected,  in  the  manner  de- 
scribed on  pages  199-200,  for  further  examination. 

Test  Function  Tested 

1.  Matching  Nth  Term  and  Series Abstract  symbol  recognition 

2.  Geometry   Formal  geometric  logic 

3.  Superposition    Spatial  relations  in  2  dimensions 

4.  Symmetry    Spatial  relations  in  2  dimensions 

5.  Matching  Solids  and  Surfaces Spatial  relations  in  3  dimensions 

6.  Reasoning    Deduction 

7.  Mixed  Relations Word  association  and  vocabulary 

8.  Logical  Opposites Word  association  and  vocabulary 

The  inter-correlations,  including  reliability  coefficients,  are 
given  in  Table  XLIV. 

TABLE  XLIV 

Inter-correlations  of  Eight  Tests  in  Population  of  61  Girls 

Entering  High  School 

(Coefficients  along  the  diagonal  are  reliability  coefficients) 


Tests 


4 

5 

6 

7 

.98 

.33 

.82 

.28 

.48 

.85 

.27 

.31 

.27 

.88 

.36 

.21 

.26 

.26 

1.  Matching   Arth    Term,    etc. 

2.  Geometry    

3.  Superposition     

4.  Symmetry    

5.  Matching  Solids,  etc 

6.  Reasoning     

7.  Mixed     Relations 

8.  Logical    Opposites 


.90 
.61 
.35 
.37 
.23 
.14 


.73 
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From  this  a  summary  table  is  obtained : 

TABLE  XLV 

Summary  of  Tetrad  Differences  in  Population  of  61  Girls 
Entering  High  School 


Value  of 

Value  of 

Variables 

No.  of  Positive 

Median  Tetrad 

Variables 

No.  of  Positive 

Median  Tetrad 

in  Pairs 

Tetrads 

if  Positive 

in  Pairs 

Tetrads 

if  Positive 

1,2 

15+  9 

.02 

3,5 

15+  3 

.01 

1,3 

15—6 

3,6 

15+  5 

.02 

1,4 

15—3 

3,7 

15—  4 

1,5 

15—15 

3,8 

15—13 

1,6 

15+  4 

.01 

4,5 

15+  2 

.00 

1,7 

15—4 

4,6 

15—  7 

1,8 

15+15 

.07 

4,7 

15—  1 

2,3 

15+  3 

.02 

4,8 

15+  2 

.03 

2,4 

15—  8 

5,6 

15+  6 

.04 

2,5 

15+  0 

.01 

5,7 

15+  8 

.02 

2,6 

15—  3 

5,8 

15—  3 

2,7 

15+  4 

.02 

6,7 

15—  6 

2,8 

15—5 

6,8 

15—  1 

3,4,    ... 

15+13 

.10 

7,8 

15+  5 

.03 

The  size  of  the  mean  tetrad  involving  variables  xx,  matching 
the  last  term  of  an  arithmetical  series  with  a  formula  which  yields 
for  successive  values  of  n  the  successive  terms  of  the  series,  and 
x8,  the  naming  of  logical  opposites,  is  .07,  and  its  standard  error 
is  .034.  It  does  not  seem  reasonable  to  attribute  this  difference  to 
chance.  If  Test  1,  dealing  as  it  does  with  the  recognition  of  ab- 
stract symbols,  is  in  large  part  verbal,  then  xxxB  bond  is  readily 
understood,  as  are  also  the  negative  bonds  between  the  spatial 
tests  and  the  verbal  tests :  xxx3,  xxx4,  xxx5,  XsX&,  and  x5x8.  Further, 
if  Test  1  does  possess  a  verbal  element,  that  is,  a  bond  with  tests 
which  we  have  earlier  called  verbal,  we  must  immediately  broaden 
or  deepen  our  concept  of  the  verbal  factor. 

To  summarize  the  results  of  our  study  of  Dr.  Roger's  data 
we  can  say:  first,  there  is  clearly  indicated  a  spatial  factor;  sec- 
ond, though  the  tests  were  used  to  forecast  ability  in  mathematics, 
the  particular  eight  tests  of  Dr.  Roger's  seventeen  which  we  have 
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studied  do  not  permit  the  proof  or  disproof  of  the  existence  of  a 
numerical  factor  or  of  a  memory  factor ;  third,  there  is  a  sugges- 
tion that  the  verbal  factor  extends  to  tasks  involved  in  the  com- 
prehension of  symbols  in  a  mathematical  formula ;  fourth,  a  factor 
not  earlier  revealed,  involving  thinking  in  terms  of  antitheses, 
whether  verbal  or  spatial,  is  suggested.  This  last  is  suggested  by 
the  XiX8  bond  in  view  of  the  negative  x3x&  bond  and  the  positive 
xzx^  bond. 

Mr.  Cureton  has  also  examined  the  data  given  by  J.  E.  W. 
Wallin  in  "Consistency  Shown  by  Intelligence  Ratings  Based  on 
Standard  Tests  and  Teachers'  Ratings"  (1922). 

Subjects  tested:  34  pupils  in  the  first  grade  of  the  Miami  Uni- 
versity Practice  School. 

Measures  employed : 

1.  Stanford-Binet  Test 

2.  Pressey  Primer  Test 

3.  Myers  Mental  Measure 

4.  Detroit  First-Grade  Intelligence  Test 

5.  Teachers'  estimates  of  intelligence 

TABLE  XLVI 
Raw  Correlation  Coefficients 


Tests 


1.  Stanford-Binet  Test 

2.  Pressey  Primer  Test 

3.  Myers  Mental  Measure 

4.  Detroit  First-Grade  Intelligence  Test 

5.  Teachers'  estimates  of  intelligence 


.455 
.678 
.439 

.487 


.379 
.508 
.380 


.464 
.557 


.297 


We  here  have  an  x2x4  bond,  which  is  not  surprising  in  view 
of  the  similarity  of  these  two  tests. 

Test  2 :  The  Pressey  Primer  Scale  is  a  picture  test  consisting 
of  four  parts :  dot  pattern,  classifications  of  familiar  objects,  form 
board  relations,  and  absurdities.  The  first  is  a  test  of  symmetry 
recognition,  the  second  of  recognition  of  common  objects,  the 
third  of  matching  geometrical  forms,  and  the  last  of  recognizing 
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the  absurdities  in  pictures  of  common  objects.  The  responses  are 
all  the  same,  "Cross  out  the  thing  that  does  not  belong." 

Test  4 :  The  Detroit  First-Grade  Intelligence  Test  consists  of 
ten  tests:  recognition  of  materials  [general  information,  as  "Mark 
the  things  made  of  wood"  in  four  pictures],  recognition  of  identi- 
cal geometric  forms,  recognition  of  common  objects,  recognition 
of  absurdities,  recognition  of  uses  of  objects  ["Mark  the  things 
you  use  with  a  knife"],  recognition  of  size  relations,  filling  in 
spaces  in  symmetrical  figures,  picture  completion,  number  ability 
["Mark  two  of  the  chairs,"  in  a  picture  in  which  three  appear], 
and  following  directions. 

This  test  is  quite  similar  in  its  elements  and  types  of  response 
called  for  to  Test  2,  many  of  the  tests  being  little  more  than  dupli- 
cate forms  of  the  same  thing. 

The  omnibus  nature  of  all  these  five  measures  makes  it  impos- 
sible to  attribute  bonds  to  detailed  mental  functions. 


TABLE  XL VII 
Summary  Table  of  Tetrad  Differences  in  Population  of  34  Pupils 

in  First  Grade 


Value  of 

Value  of 

Variables 

No.  of  Positive 

Median  Tetrad 

Variables 

No.  of  Positive 

Median  Tetrad 

in  Pairs 

Tetrads 

if  Positive 

in  Pairs 

Tetrads 

if  Positive 

1,2 

3—1 

2,4 

3+3 

.12 

1,3 

3+1 

.04 

2,5 

3+1 

.02 

1,4 

3+0 

3,4 

3+0 

1.5 

3+0 

3,5 

3+2 

.06 

2,3.     , 

3—3 

4,5 

3—3 

Mr.  James  E.  McCormack  has  examined  part  of  the  data  pro- 
vided by  Mr.  H.  G.  Stead  in  "Factors  in  Mental  and  Scholastic 
Ability"  (1926). 

Subjects :  127  boys  actually  in  an  elementary  school,  and  8 
boys  who  had  just  (at  the  time  of  testing)  been  admitted  from 
an  elementary  to  a  secondary  school.  All  of  the  boys  tested  had 
reached  their  twelfth  year,  but  none  had  yet  reached  the  age  of 
thirteen. 
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Tests  employed :  Mr.  Stead  used  four  different  types  of 
measures :  motor  tests,  character  tests,  scholastic  tests,  and  psy- 
chological tests,  only  the  last  of  which  is  here  examined.  The 
character  measures  are  not  sufficiently  objective  for  our  purposes, 
and  the  motor  and  scholastic  tests  yield  such  low  inter-correlations 
as  to  suggest  low  reliability;  in  fact  the  psychological  tests  are 
none  too  promising. 

Description  of  tests:  Stead  does  not  give  an  adequate  descrip- 
tion of  the  tests  but  refers  the  reader  to  Burt  (1922)  and  to 
Ballard  (1922).  From  an  examination  of  the  tests  in  both  Bal- 
lard and  Burt  it  is  evident  that  Stead  made  his  own  forms,  using 
the  general  types  of  tests  described  in  the  two  books.  His  brief 
descriptions  of  the  tests  show  that  he  did  not  take  tests  directly 
out  of  the  books. 

1.  Completion  Test   (Usual  continuous  passage  form  of  the 

Completion  Test.) 

2.  Opposites  Test 

3.  Instructions  Test 

Sample: 

1.  Put  a  dot  under  this  line:    


2.  Cross  out  both  A's  in  the  word  "ADA" 

3.  Make  a  girl's  name  by  adding  one  letter  to  "Mar  " 

Burt  says :  "The  various  so-called  'Instructions'  tests  are  based  on 
the  view  that  the  measurement  of  a  number  of  different  mental 
activities  provide  a  better  test  of  intelligence  than  the  measure- 
ment of  only  one  activity.  The  questions  here  used  have  been 
roughly  graded  in  order  of  increasing  difficulty.  Most  of  the  ques- 
tions indicate  a  type  that  might  well  be  made  the  basis  of  a  homo- 
geneous series  of  questions,  were  it  so  desired." 

4.  Number  Series  Test 

5.  Synonyms  Test 

6.  Cipher  Test 

It  is  very  difficult  to  determine  just  what  type  of  a  Cipher  Test 
Stead  did  use.  Burt  does  not  give  any  Cipher  Tests  and  the  test 
described  in  Ballard  does  not  follow  Stead's  simple  description. 
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Stead  described  the  Cipher  Test  briefly  by  saying  that  it  was  com- 
posed of  "five  single  words  followed  by  four  sentences."  The 
test  in  Ballard's  book  involves  a  key  which  gives  punctuation 
marks  used  to  represent  the  different  vowels  and  the  consonate  h. 
Using  this  code,  Ballard  then  asks  a  number  of  questions  which 
are  to  be  answered  by  a  single  word.  Ballard  gave  twenty-five 
such  questions,  scaled  according  to  difficulty. 

7.  Absurdities  Test 

From  Stead's  brief  description  it  would  seem  that  he  followed 
the  type  of  test  suggested  by  Ballard  rather  than  the  one  used  by 
Burt. 

Instructions : 

Here  are  20  foolish  statements.  Under  each  statement  you  will  find 
four  reasons  why  the  statement  is  foolish.  Check  the  one  which  you 
think  is  best. 

No  time  limit  was  imposed  on  this  test. 
Sample  : 

1.  A  soldier  writing  home  to  his  mother  said,  "I  am  writing  this 
letter  with  a  sword  in  one  hand  and  a  pistol  in  the  other." 
Foolish  because 

A.  The  pistol  might  go  off. 

B.  He  could  not  write  with  a  sword. 

C.  He  could  not  write  with  both  hands  occupied. 

D.  Perhaps  his  mother  could  not  read. 

8.  Analogies  Test 

The  basic  correlations  involving  these  eight  variables  are  given 
in  Table  XLVIII  and  a  summary  of  the  tetrad  differences  there- 
from is  found  in  Table  XLIX. 

There  is  a  bond  between  the  Cipher  Test,  x6,  and  the  Number 
Series  Test,  x4,  for  the  mean  t  i6i  j  tetrad  =  .07,  and  its  standard 
error  is  .028.  Because  of  the  uncertainty  of  the  writer  as  to  the 
nature  of  the  Cipher  Test,  speculation  as  to  the  nature  of  this  bond 
is  rather  profitless.  About  all  one  can  say  is  that  both  tests  involve 
a  search  for  missing  elements.  In  one  case  numbers  are  required 
to  complete  the  meaning,  and  in  the  other  vowels. 
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TABLE  XLVIII 

Inter-correlations  between  Tests  in  Population  of  127  Boys  in  an 
Elementary  School 


Tests 

l 

2 

3 

4 

5 

6 

7 

.58 
.58 
.51 
.48 
.43 
.43 
.46 

.47 
.50 
.53 
.40 
.44 
•  45 

•  51 

.48 
.41 
.45 
.38 

.34 
.50 
.35 
.40 

.33 
.41 
.39 

3.  Instructions  Test 

4.  Number  Series  Test 

.41 

.33    1    .31 

TABLE  XLIX 
Summary  Table  of  Tetrad  Differences 


Value  of 

Value  of 

Variables 

No.  of  Positive 

Median  Tetrad 

Variables 

No.  of  Positive 

Median  Tetrad 

in  Pairs 

Tetrads 

if  Positive 

in  Pairs 

Tetrads 

if  Positive 

1,2 

15+  3 

•  01 

3,5 

15+  2 

.01 

1,3 

15+  4 

.02 

3,6 

15—  2 

1,4 

15—  2 

3,7 

15+  6 

.02 

1,5 

15—  2 

3,8 

15—  6 

1,6 

15—  1 

4,5 

15—14 

1,7 

15—5 

4,6 

15+14 

.07 

1,8 

15+  3 

•  01 

4,7 

15—  9 

2,3 

15—10 

4,8 

15+  4 

.01 

2,4 

15+  1 

.00 

5,6 

15—11 

2,5 

15+10 

.03 

5,7 

15+  8 

.02 

2,6 

15—10 

5,8 

15+  7 

•01 

2,7 

15+  1 

.00 

6,7 

15+11 

.04 

2,8 

15+  5 

.01 

6,8 

15—  1 

3,4. 

15+  6 

.01 

7,8     ,.. 

15—12 

There  is  apparently  a  bond  between  the  Cipher  Test,  .r6)  and 
the  Absurdities  Test,  x7.  The  nature  of  this  is  very  uncertain. 
There  is  indicated  a  bond  between  variables  2,  opposites,  and  5, 
synonyms,  which  we  may  think  of  as  verbal  and  perhaps  also  in- 
volving the  antithesis  bond  suggested  by  Dr.  Roger's  data. 

A  very  recent  contribution  emanating  from  Spearman's  labora- 
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tory  is  the  study  of  Hargreaves  upon  "The  'Faculty'  of  the 
Imagination"  (1927).  In  this  study  the  older  criteria  of  hierar- 
chical order  and  correlations  between  columns  have  been  entirely 
discarded  and  a  much  sounder  procedure  based  upon  tetrad  dif- 
ferences has  been  followed  throughout.  Though  the  present  writer 
still  feels  the  necessity  of  making  a  reservation  as  to  the  statistical 
soundness  of  one  of  Spearman's  techniques  which  has  been  used, 
that  of  determining  the  standard  deviation  (or  probable  error)  of 
the  distribution  of  all  the  tetrad  differences  coming  from  a  table 
of  inter-correlations  (see  above,  page  12),  he  nevertheless  does 
not  take  exception  to  the  detailed  findings.  In  other  words,  if  the 
formula  giving  the  standard  deviation  is  in  error,  it  is  probably 
not  grossly  in  error,  for  conclusions  reached  by  its  use  are  much 
in  line  with  those  following  a  very  different  procedure  (for  ex- 
ample, that  of  previous  chapters  involving  the  standard  error  of 
a  mean  tetrad).  Though  Hargreaves'  purpose  is  to  determine  the 
existence  and  nature  of  imagination,  he  provides  data  on  a  large 
number  of  other  points. 

One  point  upon  which  we  particularly  would  have  liked  infor- 
mation is  almost  entirely  neglected,  for  he  scarcely  considers  the 
effect  of  maturity,  racial,  and  sex  differences  on  measures  of  cor- 
relation. All  he  writes  in  regard  to  his  group  is  as  follows :  "The 
tests  were  given  to  five  classes  (two  of  boys  and  three  of  girls) 
in  three  schools,  A,  B,  C.  The  total  number  of  children  was  200, 
but  absences  reduced  these  ultimately  to  151.  Their  average  age 
was  12.8."  From  this  we  have  no  means  of  determining  how  large 
a  factor  maturity  is.  The  question  does  not  seem  to  have  occurred 
to  Hargreaves. 

Dr.  Hargreaves  finds  a  small  "fluency"  factor,  which  is  meas- 
ured by  the  following  tests:  A — Unfinished  Picture  Test,  B — 
Unfinished  Stories  Test,  C — Writing  Words  (the  number  of  dis- 
connected words  written  in  three  minutes). 

He  also  finds  a  speed  factor  which  he  surmises  to  be  more  than 
merely  speed  of  writing,  though  it  is  found  in  the  two  following 
tests  :  A — Speed  in  Writing  Figures,  B — Speed  in  Copying  Prose. 

After  quoting  Lankes,  Wynn  Jones,  and  Bernstein  as  having 
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found  evidence  of  a  ''preservation"  factor,  he  states  that  there  is 
similar  evidence  to  be  gathered  from  certain  of  his  tests:  (a)  Re- 
versed Stroke  Test.  ( Figures  2  3  4  5  6  7  were  written  rapidly  and 
repeated  for  thirty  seconds.  They  were  then  written  in  the  reverse 
order  both  as  to  each  figure  and  as  to  the  order  of  the  figures. 
The  score  is  a  measure  of  the  relative  efficiency  of  the  reverse 
writing  in  comparison  with  the  direct.)  (b)  Inverted  5  Test. 
(Subjects  wrote  both  S  and  a  reverse  5"  according  to  a  designated 
arrangement.  The  score  is  similar  to  that  for  the  Reversed  Stroke 
Test.)  (c)  I  T  Test.  (A  given  paragraph  was  copied  rapidly  for 
two  minutes.  It  was  then  copied  again  with  the  instructions  that 
the  *'s  were  not  to  be  dotted  nor  the  t's  crossed.  The  score  is  a 
function  of  the  accuracy  and  the  speed  with  which  this  was  done. 
The  reliability  proved  to  be  very  low,  .41.) 

Dr.  Hargreaves'  finds  evidence  to  attribute  speed  and  another 
unknown  factor  to  "absence  of  inhibitions."  He  concludes  that 
such  speed  is  not  operative  in  power  tests. 

Having  found  these  various  factors  he  considers  that  they 
quite  adequately  account  for  fluency  of  imagination.  Therefore 
it  is  not  necessary  to  postulate  such  a  factor  as  over  and  above 
those  already  mentioned.    He  writes  the  equation : 

Fluency  of  Imagination  =  g  +  Speed  -f-  Memory  -f-  x 
in  which  g  is  the  general  factor,  and  Speed  and  x  are  conative, 
depending  upon  the  absence  of  inhibitions. 

He  also  states :  "When  imagination  tests  are  marked  for 
originality,  denoting  by  this  the  extent  to  which  a  subject's  ideas 
are  novel  or  uncommon,  the  imagination  (originality)  tests  have 
some  common  group  factor,  but  very  little  relationship  to  g." 
This  factor  is  compound,  and  if  in  part  separate  from  other  fac- 
tors mentioned,  the  magnitude  of  this  part  is  small. 

This  monograph  refers  to  certain  results  of  other  workers 
which  have  bearing  upon  our  general  problem.  Burt  is  quoted  as 
having  found  that  "linguistic  ability  and  attainments  exert  upon 
the  Binet-Simon  Tests  a  special  and  positive  influence  of  their 
own."  Schwegler  (1920)  and  Winn  are  quoted  as  having  found 
that,  though  colored  children  do  not  exceed  white  children  in  any 
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test,  they  do  equal  them  in  (1)  common-sense  adjustment  to 
practical  situations,  (2)  rote  memory  tests  not  requiring  manipu- 
lation of  material,  (3)  tests  involving  primary  verbal  facility. 
Since  the  populations  tested  were  very  small  and  almost  undoubt- 
edly far  from  constituting  random  age  groups,  we  can  attach  but 
little  significance  to  these  results. 

The  data  of  Bonser  (1910)  are  particularly  interesting  for  our 
study  because  they  have  been  repeatedly  cited  by  Spearman,  the 
last  citation  appearing  in  his  Abilities  of  Man  (1927)  as  giving 
evidence  of  the  operation  of  a  single  general  factor.  Bonser's 
group  in  fact  constitutes  the  only  large  population  that  Spearman 
does  cite  as  supporting  his  view.1 

In  view  of  Spearman's  criticism  of  other  writers  who  provide 
data  that  do  not  support  the  general  factor  theory,  because  of 
their  failure  to  properly  take  into  account  differences  in  maturity 
and  sex  (1927,  p.  159),  is  it  not  peculiar  that  he  cites  Bonser's  data 
(1910)  at  all  at  this  late  date,  for  this  group  of  757  is  com- 
posed of  385  boys  and  372  girls  of  an  age  range  from  eight  to 
sixteen,  found  in  the  upper  divisions  of  fourth,  fifth,  and  sixth 
grades  in  five  different  public  schools.  To  use  the  words  of  Spear- 
man in  criticizing  others,  surely  "heterogeneity  in  age,  sex,  etc. 
.  .  .  .  has  been  allotted  to  run  riot."  If  these  things  have  not 
been  uncontrolled  in  this  population,  what  does  constitute  lack  of 
control?  Though  Spearman  has  cited  heterogeneity  as  a  disturb- 
ing influence  in  the  works  of  others,  he  seems  really  to  have  given 
very  little  thought  to  it.  It  seems  but  fair  to  charge  him  with  lack 
of  concern  with  maturity  and  sex  as  causing  a  general  factor. 
The  failure  of  his  pupil  Hargreaves  is  the  most  recent  piece  of 
evidence.  Unfortunately  this  point  of  view  has  been  operative  in 
Spearman's  early  work  as  well.    For  reasons  already  given  above, 


1  Though  Spearman  writes  (1927,  p.  238),  ".  .  .  .  the  tests  employed  by 
the  present  writer  with  some  30,000  candidates  for  the  British  Civil  Service 
....,"  it  nevertheless  is  obvious  that  his  correlations  and  tetrad  differences 
were  not  based  upon  this  entire  population,  for  he  gives  (ibid.,  p.  239)  a 
tetrad-difference  probable  error  of  .007,  thus  conclusively  indicating  that  the 
population  for  this  particular  study  was  much  less  than  30,000. 
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in  chapter  ii,  differences  in  maturity,  sex,  and  race  may  be  looked 
upon  as  quite  sufficient  to  account  for  any  general  factor  that 
may  be  found  whenever  these  things  are  not  taken  account  of. 
We  may  accordingly  anticipate  a  large  general  factor  in  the  Bon- 
ser  data.  Even  so,  the  writer  does  not  believe  that  this  general 
factor  is  so  large  as  entirely  to  obscure  a  second  factor  in  these 
data.   The  following  table  is  pertinent  in  this  connection. 

TABLE  L 

Inter-correlations  between  Tests  in  Population  of  757,  Consisting 

of  385  Boys  and  372  Girls  from  the  Upper  Division  of 

Grades  4,  5,  and  6,  from  Five  Public  Schools,  Ages  8-16 


Tests 


1.  Mathematical  judgment. 

2.  Controlled  association  . . 

3.  Literary  interpretation   . 

4.  Selective   judgment 

5.  Spelling 


.485 
.400 
.397 
.295 


.397 
.397 
.247 


.335 
.275 


•  195 


It  may  be  readily  shown  that  when  spelling  is  omitted  the  other 
four  variables  yield  tetrads  very  closely  equal  to  zero,  and  could 
therefore  be  readily  explained  as  due  to  one  general  factor  (g  ac- 
cording to  Spearman,  and  probably  maturity  and  sex  according  to 
the  present  writer).  Spelling,  however,  involves  in  addition  to  a 
large  maturity  factor  special  "memory"  and  "contentment  with 
drill"  factors  (see  Kelley,  1926)  which  form  special  bonds  with 
certain  of  the  other  four  variables.  Let  us  consider  the  mean 
tetrads,  together  with  their  probable  errors,  involving  .r5,  the 
variable  spelling: 


Mean  t1BiJ=  .009 
Mean  t2  5 » ,-  =  -.015 
Mean  tt6ii=    .025 


Mean  t4 


.019 


P.E.t  =  .007 
P.E.*  =  .007 
P.E.,  =  .008 
P.E.t  =  .008 


Surely  one  should  conclude  that  these  four  mean  tetrads  are  not 
mere  chance  deviations  from  zero. 
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These  data  have  been  considered  in  detail,  not  because  they  are 
appropriate  for  the  study  of  independent  mental  factors,  but  be- 
cause they  are  based  upon  the  only  large  population  quoted  by 
Spearman  as  supporting  his  view. 

The  writer  feels  that  Spearman  is  guilty  of  one  other  serious 
oversight  in  addition  to  his  lack  of  concern  with  maturity,  etc., 
and  that  is  a  failure  to  appreciate  that  his  point  of  view  cannot  be 
statistically  established  by  a  study  of  small  populations.  Doubly 
serious  is  this  shortcoming  if  the  instruments  of  measurement 
are  not  precise. 

Let  us  illustrate  this  by  an  entirely  different  problem.  A  cer- 
tain person  tosses  ten  coins,  upon  the  twenty  faces  of  which  are 
a  heads  and  b  tails  (a  =  11  and  b  =  9,  but  this  fact  is  not  known 
to  the  experimenter).  These  are  tossed  ten  times  with  the  result 
that  there  turn  up  a  total  of  55  heads  and  45  tails.  The  experi- 
menter maintains  that  the  coins  have  ten  heads,  and  he  argues 
that  since  the  standard  error  of  the  number  of  heads  in  this  num- 
ber of  tosses  is  equal  to  5,  and  since  he  got  a  number  of  heads, 
namely  55,  which  could  readily  have  occurred  as  a  matter  of 
chance,  there  is  no  reason  for  him  to  revise  his  judgment,  so  he 
continues  to  maintain  that  the  number  of  heads  on  the  coins  is  10. 
It  must  be  obvious  that  if  he  does  not  increase  his  population 
he  will  never  prove  to  his  own  satisfaction  that  the  number  of  heads 
is  not  ten. 

It  would  be  particularly  hard  for  one  adopting  Spearman's 
standard  to  disprove  such  a  conviction  once  held,  because  Spear- 
man demands  an  unduly  extreme-  divergence  from  chance  results 
before  an  accepted  hypothesis  is  to  be  discredited.  On  page  295 
of  Abilities  of  Man,  he  writes: 

The  tetrad  difference  does  indeed  have  the  high-looking  value  of 
.20,  but  even  this  becomes  insignificant  upon  comparing  it  with  the 
probable  error,  which  is  .13.1  [Spearman's  footnote]  1  The  reader  may 
be  reminded  that  an  experimental  value  should  be  at  least  three  times 
larger  than  its  probable  error  before  it  can  be  taken  even  as  suggestive, 
and  it  must  be  five  times  larger  before  its  evidence  can  be  deemed  con- 
clusive.  See  pages  140-141. 
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Again  on  page  141  he  writes  in  connection  with  the  establishment 
of  a  conclusion : 

Most  summary  of  all  is  to  see  whether  or  not  the  largest  observed 
tetrad  difference  exceeds  five  times  the  magnitude  of  their  probable 
error, 

and  again  on  page  238 : 

The  tetrad  difference  comes  to  .090  which  is  only  three  times  its 
probable  error,  .030,  and  therefore  is  not  conclusive. 

This  standard  for  determining  significance  seems  to  the  writer 
very  unsound  because  it  is  altogether  too  exacting.  In  brief,  it 
seems  to  the  writer  that  wherever  there  was  one  chance  in  two, 
or  half  a  chance,  or  even  a  much  smaller  fraction  of  a  chance, 
Spearman  has  interpreted  results  in  favor  of  his  theory. 

The  populations  studied  in  detail  in  earlier  chapters  of  this  work 
are  admittedly  far  too  small  and  too  heterogeneous  to  yield  very 
adequate  or  true  pictures.  However,  any  such  defect  has  operated 
to  make  the  discovery  of  second,  third,  and  fourth  independent 
factors  difficult,  while  at  the  same  time  it  would  tend  to  make  ap- 
pear quite  adequate  a  single  factor.  In  spite  of  heterogeneity  and 
small  population  thus  working  against  a  multiple-factor  hypothe- 
sis, the  populations  which  were  studied  do  not  point  to  the  suffi- 
ciency of  a  single  general  factor,  so  that  it  may  well  be  believed 
that  results  from  the  study  of  still  larger  populations  would  be 
still  less  in  harmony  with  the  single- factor  hypothesis. 

The  special  study  of  the  inter-correlations  between  the  eight 
sub-tests  of  the  Army  Alpha  Test,  conducted  by  the  Division  of 
Psychology  of  the  Surgeon  General's  Office  (Yerkes,  1921),  pro- 
vides data  upon  a  large  population  of  American  white  English- 
speaking  adults  in  nine  different  army  camps.  The  special  merits 
of  these  data  are  that  they  cover  a  large  population,  sex  is  con- 
stant, and  maturity  substantially  constant.  The  defects  are  that 
racial  homogeneity  is  not  attained,  the  tests  separately  have  low 
reliability,  and  a  technique  of  treatment  was  followed  which  makes 
it  impossible  to  calculate  the  probable  errors  of  the  correlation  co- 
efficients or  of  the  tetrad  differences.    The  number  of  cases  ex- 
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amined  was  1,047,  and  it  was  found  that  the  distribution  of  a 
number  of  sub-tests  gave  undistributed  extreme  scores,  zero,  or 
perfect  scores.  Accordingly,  all  correlations  were  corrected  for 
these  undistributed  scores,  to  obtain  estimates  of  the  correlation 
maintaining  if  the  tests  had  permitted  lower  or  higher  scoring  as 
required.  Though  the  writer  sees  no  reason  to  believe  that  these 
very  carefully  made  corrections  either  introduced  or  took  out  any 
general  or  group  factors,  still  it  is  true  that  the  corrections  are  of 
such  magnitude  that  ordinary  probable-error  formulas  may  not  be 
used  for  the  determination  of  reliability. 
The  sub- tests  of  the  Army  Alpha  are : 

1.  Directions:    Oral   directions   requiring   the   making   of 

marks  in  geometric  forms,  etc.,  on  the  test  blank. 

2.  Arithmetic-reasoning  problems. 

3.  Practical  Judgment:  One  of  three  choices  of  action  to 

be  indicated  in  each  of  16  series. 

4.  Synonym-Antonym. 

5.  Disarranged  Sentences. 

6.  Number  Series. 

7.  Analogies. 

8.  Information:  One  of  four  alternative  responses  to  be 

marked. 
Tables  LI  and  LII  give  the  inter-correlations  and  a  summary  of 
the  tetrad  differences. 

TABLE  LI 

Correlations    between    Eight    Sub-Tests    of   the    Army   Alpha    in 

Population  of  1,047  Men  Picked  as  a  Special  Experimental 

Group  from  the  United  States  Army 


Tests 


1.  Directions    

2.  Arithmetic  

3.  Practical  Judgment 

4.  Synonym- Antonym 

5.  Disarranged    Sentences. 

6.  Number  Series 

7.  Analogies 

8.  Information 


•  730 

.590  .745 
.710  -791 
.686  .763 
.680!  .773 
.670  !  .736!  .671 

•  658,  .742^  .775 


.805 
•  754 
.613 


.834 
.681 


.674 


.730    .778 


.704 


.861    .823    .693 


.672 


8 


MENTAL  FACTORS  IN  PUBLISHED  STUDIES 


217 


TABLE  LII 

Summary  Table  of  Tetrad  Differences  in  Population  of  1,047 
White  Male  Adults 


No.  of  Positive 

Value  of  Mean 

Variables 

No.  of  Positive 

Value  of  Mean 

in  Pairs 

Tetrads 

Tetrad 

in  Pairs 

Tetrads 

Tetrad 

1,2 

15+  5 

.034 

3,6 

15—  8 

041 

1,3 

15—14 

—  062 

3,7 

15—  3 

—  015 

1,4 

15+  0 

—  .010 

3,8 

15+  7 

.048 

1,5 

1,6 

1,7  .... 
1,8 

15+  0 
15+  5 

15+  9 
15-  5 

— 016 
.052 
.028 

—.028 

4,5 

4,6.    ... 
4,7 
4,8 

15+  0 
15—11 
15—  4 
15+11 

.013 

—  .054 

—030 

.056 

2,3 

15+  7 

.008 

2,4 

15—  5 

—.026 

5,6 

15-  7 

— 042 

2,5 

15—  7 

—.036 

5,7 

15+  8 

.040 

2,6 

15+12 

.058 

5,8 

15+  4 

.028 

2,  7 

15—  5 

—.002 

2,  8 

15—  7 

—.041 

6,7 

15+  7 

.033 

6,8 

15+  2 

— 010 

3,4 

15+  9 

.049 

3,5 

15+  2 

.013 

7,8       . 

15—12 

—053 

The  standard  errors  of  four  mean  tetrads  have  been  calcu- 
lated by  Formula  64  with  the  result  noted  below,  but  the  reader 
is  warned  not  to  place  much  trust  in  these  values  because  of  the 
curtailment  of  the  original  distribution  and  the  consequent  ad- 
justments that  were  made. 


'l  3  i  J  = 

-.062 

ot  =  .0075 

*  2  6  i  }    = 

.058 

Gt  =  .0074 

(4  5  i  i  = 

.013 

at  =  -0062 

'4  6  (  )    = 

-.054 

ot  =  .0053 

After  making-  considerable  allowance  for  the  uncertainty  of  our 
results  it  still  seems  that  a  number  of  important  factors  are  indi- 
cated. The  probable  explanation  of  the  bonds  found  are  given  in 
Table  LIII. 
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TABLE  LIII 
Bonds  Suggested  by  the  Army  Alpha  Data 


Variables 
in  Pairs 


1,2.... 
1,6.... 
2,6.... 
3,4.... 


Mean  Tetrad 
Difference 


.034 
•  052 
.058 
.049 


Probable  Nature 
of  Bond 


Numerical  factor 
Numerical  factor 
Numerical  factor 
Verbal  factor 


Variables  Mean  Tetrad      Probable  Nature 
in  Pairs       Difference  of  Bond 


3,8. 
4,8. 
5,7. 
6,7. 


.048 
.056 
.040 
•  033 


Verbal  factor 

Verbal  factor 

p 


The  general  nature  of  the  factors  suggested  by  this  table  is  in 
considerable  agreement  with  that  deduced  from  previous  studies. 


CHAPTER    X 

FURTHER  APPROACHES  TO  AND  FUTURE 

OUTCOMES  OF  A  DETERMINATION  OF 

UNITARY  MENTAL  TRAITS 

Though  the  utilization  of  judgments  in  the  determination  of 
mental  structure  is  fraught  with  difficulty,  it  can  be  made  to  pro- 
vide suggestions  for  objective  measurement,  and  in  its  own  right 
it  provides  a  very  fascinating  means  of  studying  the  independence 
of  mental  concepts  of  judges.  Dr.  Shen  (1924,  Experimental; 
1925,  Validity;  1925,  Influence;  1925,  Reliability)  has  employed 
very  effectively  the  judgments  of  acquaintances.  The  subjects 
consisted  of  28  Chinese  male  students  in  American  colleges,  and 
judgments  were  made  upon  the  following  traits: 

1.  Intellectual   Quickness  =  ability    to   think,    understand, 

and  learn  rapidly. 

2.  Intellectual    Profoundness  =  ability    to    think,    under- 

stand, and  learn  thoroughly. 

3.  Memory  =  facility   to    remember   or   retain   ideas   cor- 

rectly. 

4.  Impulsiveness  =  tendency   to   act    without   a   thorough 

plan  and  take  a  chance. 

5.  Adaptability  =  ability  to  adjust  oneself  to  new  require- 

ments, to  new  problems  and  conditions  of  life. 

6.  Persistence  =  ability  to  maintain  a  definite  purpose  un- 

til it  is  attained. 

7.  Leadership  =  ability    to    lead    in    any    (except    purely 

physical)  organized  activity,  to  inspire  confidence 
and  secure  co-operation  and  support  of  one's  col- 
leagues. 

All  subjects  were  also  judges,  and  as  they  had  been  classmates 
for  from  three  to  nine  years,  the  intimacy  of  acquaintance  was 
greater   than   is   ordinarily   the   case   in   judgment   studies.     The 
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technique  was  drawn  up  with  a  view  to  avoiding'  systematic  errors. 
The  basic  table  of  inter-correlations  is  given  in  Table  LIV : 

TABLE  LIV 
Correlations  of  Final  Composite  Ratings 
r12  Raw  coefficients  are  in  Roman  type. 
roow  Corrected  coefficients  are  italicized. 
(oroow)   Standard  errors  are  in   parentheses. 
All  decimal  points  are  omitted. 


Traits 


JO 


a  s 

H  p 


Intellectual  Profound- 
ness    

Memory   

Impulsiveness   

Adaptability    

Persistence    

Leadership  

Scholarship    


92 

(04) 

95 

93 

99 

98 

(02) 

(03) 

-21 

-40 

-24 

—46 

(21) 

(18) 

54 

31 

56 

33 

(14) 

(18) 

49 

77 

53 

78 

(15) 

(09) 

66 

79 

69 

53 

(11) 

(07) 

91 

91 

95 

95 

(03) 

(03) 

—28 
— 32 
(21) 

37 
59 

(17) 

60 
64 
(13) 

65 
69 
(11) 
96 

(02) 


—01 

—02 
(22) 

—28 
— 33 
(21) 

—24 
—29 
(21) 

-24 
—27 
(21) 


03 

(20) 

50 
53 
(15) 

37 
38 
(17) 


77 
SJ 
(08) 

62 
66 
(12) 


64 
67 
(ID 


Dr.  Shen  has  allowed  for  the  chance  element  in  the  measures  by 
using  coefficients  corrected  for  attenuation,  and  he  has  provided 
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the  standard  errors  of  these  corrected  coefficients.  Though  the 
population  is  small,  the  unusual  intimacy  of  acquaintance  makes 
this  study  most  interesting,  whether  looked  upon  as  a  study  of 
the  relationship  of  ideas  in  the  minds  of  judges,  or  of  the  relation- 
ship of  traits  in  people.  Dr.  Shen  has  kindly  permitted  the  writer 
to  quote  from  his  dissertation  at  some  length,  and  the  writer  is 
glad  to  do  so  because  the  dissertation  is  not  in  print.  The  reader 
can  establish  for  himself  the  reasonableness  of  Dr.  Shen's  obser- 
vations by  an  analysis  of  the  raw  data  given  in  full  in  Table  LIV. 

The  correlation  [corrected  for  attenuation]  between  them  [Intellec- 
tual Quickness  and  Intellectual  Profoundness]  though  very  high  is 
more  than  two  times  the  standard  error  below  unity,  justifying  the 

postulation  of  a  difference According  to  our  own  results,  the 

intellectually  quick  is  more  impulsive,  more  adaptable,  but  less  per- 
sistent, than  the  intellectually  profound.  In  fact,  with  these  three  traits 
constant,  the  partial  correlation  between  quickness  and  profoundness 
reaches  perfect  unity.  As  our  population  is  rather  small,  a  partial  cor- 
relation with  three  constants  has  a  low  reliability.  None  the  less,  it 
seems  entirely   reasonable  that  the  difference  between  quickness  and 

profoundness  is  due  to  such  modifying  factors the  difference 

between  quickness  and  profoundness  seems  best  explainable  in  terms 
of  attention,  interest,  and  attitude.  Quickness  means  shifting  attention, 
unspecialized  interest,  and  alert  attitude;  the  mind  is  set  upon  reacting 
upon  the  environment  for  immediate  ends.  Profoundness,  on  the  other 
hand,  means  sustained  attention,  specialized  interest,  and  careful  atti- 
tude; the  mind  is  set  upon  ignoring  immediate  distractions  and  reacting 
for  more  remote  ends.  On  the  negative  side,  the  quick  is  often  super- 
ficial and  accomplishes  little  of  importance,  while  the  profound  is  some- 
times hopelessly  dull  and  stupid.  The  difference  seems  to  be  largely 
acquired  and  to  a  certain  extent  controllable.  Everybody  is  quicker  at 
one  time  and  more  profound  at  another.  Mental  tests  are  unable  to  find 
the  difference  because  the  subjects  are  instructed  to  work  as  rapidly  as 
possible  and  to  turn  their  attention  from  one  item  to  another,  leaving 
no  freedom  for  their  natural  or  habitual  inclination.  This  at  least 
partly  explains  why  McQueen  (1917)  finds  no  general  attention  factor 
and  Bernstein  (1924)  finds  no  general  speed  factor.  While  we  feel 
entirely  justified  to  recognize  the  difference,  we  do  not  mean  to  forget 
their  more  important  similarity. 
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In  regard  to  memory : 

The  perfect  correlation  of  unity  with  scholarship  indicates  that  the 
latter  must  have  been  almost  the  exclusive  criterion,  supplemented 
probably  by  a  small  amount  of  casual  observations  of  incidental 
memory. 

Impulsiveness  is  perhaps  the  most  interesting  of  our  eight  traits. 
It  has  a  negative  correlation  with  all  the  other  traits.  Thomson  ( 1924) 
and  Thurstone  (1921,  1924)  have  pointed  out  that  inhibition  is  an 
important  factor  of  intelligence,  and  our  impulsiveness  seems  to  be 
nothing  other  than  the  lack  of  inhibition.  The  highest  negative  corre- 
lation that  impulsiveness  has  is  — .46  with  intellectual  profoundness. 
If  we  now  hold  the  latter  constant  and  calculate  partial  correlations  of 
impulsiveness  with  the  other  traits,  the  results  become  all  positive,  as 
follows : 

With  intellectual  quickness 53 

With  memory 74 

With   adaptability 16 

With  persistence 05 

With  leadership 18 

With  scholarship 60 

Apparently,  then,  with  a  given  amount  of  intellectual  profoundness, 
impulsiveness  actually  increases  quickness,  facilitates  memory,  makes 
an  individual  at  once  more  adaptable  and  more  persistent,  as  well  as  a 
better  leader  and  a  better  scholar.  The  paradox  is  far  from  unreason- 
able. When  impulses  are  regulated  by  intellect,  it  means  energy,  vigor, 
and  activity  without  rashness.  Intelligence  held  constant,  more  success 
naturally  follows  more  trial  and  error.  While  intelligent  behavior  re- 
quires a  certain  amount  of  inhibition,  inhibition  cannot  be  substituted 
for  intelligence. 

The  low  correlation  of  .03  between  adaptability  and  persistence 
apparently  indicates  that  the  two  traits  are  independent.  Closer  analy- 
sis, however,  will  reveal  that  they  are  really  supplementary  in  one  sense 

and  antagonistic  in  another Withholding  intelligence,  adaptability 

becomes  aimless  change  and  persistence  remains  mere  obstinancy.  The 
partial  correlation  between  them,  with  either  intellectual  quickness  or 
intellectual  profoundness  constant,  is  — .38,  showing  that  they  are 
actually  opposing  tendencies  which  only  intelligence  can  put  into  co- 
operation. It  is  probably  due  to  this  antagonism  that  character  and 
intelligence  are  often  contrasted.    The  adaptable  may  take  as  means 
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what  is  commonly  regarded  as  end  and  thus  become  cleverly  unprin- 
cipled. The  persistent,  on  the  other  hand,  may  seriously  take  a  means 
as  end  and  thus  remain  faithfully  foolish.  The  contrast  is,  however, 
not  justifiable  so  long  as  intelligence  is  able  to  overshadow  the  dif- 
ference. With  a  given  degree  or  amount  of  intelligence,  the  relative 
predominance  of  adaptability  or  persistence  seems  partly  due  to  heredity 
and  partly  due  to  environment.  McDougall  (1921)  has  already  pointed 
out  that  the  black  man  is  more  adaptable  while  the  red  man  is  more 
persistent.  A  similar  difference  in  milder  degree  is  here  tentatively 
suggested  between  the  southerner  and  the  northerner  in  China. 

Leadership  depends  more  upon  intellectual  profoundness  than  upon 
intellectual  quickness,  and  more  upon  persistence  than  upon  adaptabil- 
ity. Its  multiple  correlation  with  adaptability  and  persistence  together 
is  almost  perfect,  .97.  This  multiple  correlation  remains  as  high  as 
.91,  even  when  intellectual  profoundness  is  held  constant.  Leadership, 
then,  does  not  seem  to  require  very  high  abstract  thinking  beyond  a 
co-operation  of  adaptability  and  persistence. 

While  leadership  and  scholarship  have  a  total  correlation  of  .67, 
their  partial  correlation  with  intellectual  profoundness  constant  is  —.68. 
This  is  but  natural,  since  both  traits  correlate  high  with  intelligence, 
which  is  responsible  for  their  positive  correlation.  With  a  given  de- 
gree of  intelligence,  a  better  leader  is  a  poorer  scholar,  and  vice  versa, 
though  one  may  be  intelligent  enough  to  be  good  in  both. 

.  .  .  .  Our  analysis  shows  that  among  them  the  intellectual 
qualities,  impulsiveness,  adaptability,  and  persistence  are  the  most  im- 
portant, interesting,  and  fundamental  traits.  It  seems  that  intelligent 
behavior  is  largely  the  regulation  of  impulses  and  the  co-operation  be- 
tween adaptability  and  persistence,  while  intellect  may  involve  a  more 
abstract  analytical  capacity  besides. 

It  has  already  been  pointed  out  that  elements  of  genetic  struc- 
ture, which  are  independent  and  at  the  root  of  intellectual  life, 
could  conceivably  be  selected  by  breeding,  resulting  in  races  show- 
ing substantial  differences  in  the  trait  bred  in  or  out.  There  is 
much  casual  observation  which  is  very  suggestive  from  this  point 
of  view  and  there  is  also  considerable  quantitative  measurement. 
As  it  is  beyond  the  scope  of  the  present  treatment  to  review  these 
studies  in  detail,  we  will  examine  one  only  as  a  sample. 

Dr.  Darsie  (1926)  studies  the  mental  capacities  of  American- 
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born  Japanese  children.  He  in  part  controlled  the  language  prob- 
lem by  examining  such  Japanese  as  were  thoroughly  familiar  with 
English. 

The  investigation  was  limited  to  American-born  Japanese  children 
between  the  ages  of  ten  and  fifteen  inclusive.  Such  children  had  in 
most  cases  never  been  out  of  America,  they  had  attended  English- 
speaking  schools  for  at  least  four  or  five  years,  and  with  the  exception 
of  certain  rural  groups  English  was  the  language  most  familiar  to 
them.  Every  effort  was  made  to  secure  a  group  which  would  be  thor- 
oughly representative  of  the  race  in  California. 

The  Stanford-Binet,  the  Stanford  Achievement,  and  the  Army- 
Beta  Tests  were  given.  A  ten-point  difference  in  Stanford-Binet 
IQ  in  favor  of  the  American  white  child  was  found,  but  in  spite 
of  the  care  in  selection  it  is  reasonable  to  think  that  some  though 
hardly  all  of  this  may  be  due  to  a  language  handicap  arising  from 
the  fact  that  many  of  the  Japanese  were  bilingual.  This  gross 
difference  does  not  concern  us  nearly  so  much  as  does  evidence  of 
difference  along  detailed  lines.  Let  us  consider  the  separate  tests 
involved. 

The  Beta  results  indicated  equality  of  American  and  Japanese 
performance  for  ages  below  twelve.  At  the  age  of  twelve  the 
Japanese  were  appreciably  superior.  Table  LV  lists  the  various 
tests  and  offers  tentative  explanation  of  any  marked  differences 
found. 

TABLE  LV 
Japanese-White  Differences  upon  Army  Beta  Tests 

Suggestions  as  to  Certain 
Tests  Differences  of  the  Mental  Factors 

Digit  Symbol  Test Marked  Japanese  Involved 

superiority Numerical  and  memory 

Number  Comparison  Test.  .Marked  Japanese 

superiority Numerical  and  memory 

Picture  Completion  Test.  .Appreciable  white 

superiority Spatial   relationships 

(1)  and  (2) 

Cube  Analysis  Test Slight  Japanese  superiority 

Maze   Slight  white  superiority 

Series  Completion  Test. ..  .Insignificant  difference 
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The  results  of  Stanford  Achievement  Tests  are  summarized 
in  Table  LVI.  Coarser  age  groupings  are  here  employed  than  in 
Darsie's  monograph. 


TABLE  LVI 
Japanese-White  Differences  upon  Stanford  Achievement  Tests 

Suggestions  as  to  Mental 
Tests  Differences  Factors  Involved 

Reading   Marked  white  superiority Verbal 

Language  Usage Appreciable  white  superiority. .  .Verbal 

Spelling  Slight  Japanese  superiority Verbal  and  memory 

Arithmetic Negligible  difference Verbal  and  numerical 

Information  Tests.  .Slight  white  superiority Verbal,  some  memory 

and  other  factors 

In  Table  LVII  the  separate  tests  of  the  Stanford-Binet  are 
ranked  in  order  of  white  superiority  to  Japanese.  The  population 
yielding  these  data  was  of  the  mental  age  twelve.  The  fact  that 
the  subjects  are  not  of  the  same  chronological  age  somewhat  com- 
plicates the  interpretation  of  the  results.  The  figure  in  the  second 
column  gives  the  Japanese- White  difference  divided  by  its  stand- 
ard error. 

TABLE  LVII 

Japanese-White  Differences  upon  Elements  in  the  Stanford- 
Binet  Test 

Difference  Suggestions  as  to  Certain 

Test  Element  Standard  Error  of    the    Factors    Involved 

1-XII-l.  Vocabulary  40 (  —  10.50)       Verbal 

2-X-l.  Vocabulary    30 (—  7.92)       Verbal 

3-XII-2.  Abstract  Words  Defined...  (—  4.73)       Verbal 

4-XIV-l.  Vocabulary  50 (—  4.44)       Verbal 

5-XIV-A1  1.  Seven  Digits (—  4.02)       Verbal,     numerical,     and 

memory 
6-X-A1 1.  Six   Digits (—3.96)       Verbal,     numerical,     and 

memory 

7-XVIII-4.  Logical  Memory (—  3.53)       Verbal  and  memory 

8-XVI-3.  Differences    between    Ab- 
stract Words   (—  3.21)       Verbal 
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TABLE  INll— Continued 

Difference  Suggestions  as  to  Certain 

Test  Element  Standard  Error  of   the    Factors    Involved 

9-XII-4.  Dissected  Sentences (—  3. 13)       Verbal 

10-XVIII-3.  Eight  Digits (—  2.50)       Verbal,     numerical,     and 

memory 
ll-X-5.  Comprehension  Fourth   De- 
gree     ' (-  1-98)  ? 

12-XII-5.  Fables  4 (—  1.79)       Verbal 

13-XIV-6.  Reversing  hands  of  clock  (—  1.50)       Spatial  relationships    (1) 

14-X-6.  Sixty  Words (—  1.30)       Verbal 

15-XVI-2.  Fables  8 (—  1.11)       Verbal 

16-XIV-4.  Problems,  Fact (—  1.06)       Verbal 

17-XIV-5.     Arithmetic  Problems ( —  0.31)       Verbal  and  numerical 

18-X-2.  Absurdities    (  —  0.11)       Verbal 

19.5-XII-6.  Five  Digits   Reversed...  ( —  0.10)       Verbal,  numerical,  spatial, 

and  memory 

19.5-XII-3.  Ball  and  Field (—0.10)       Spatial 

*22-XVI-l.  Vocabulary  65 (       0.00)       Verbal 

22-IX-6.  Rhymes   (       0.00)       Verbal 

22-IX-3.  Making  Change (       0.00)       Verbal  and  numerical 

24-XII-8.  Similarities  (+  0.41)       Verbal 

25-X-4.  Reading  Memory (+  0.62)       Verbal  and  memory 

26-IX-A1  1.  Name  of  Month (  +  0.99)       Memory 

27-XII-7.  Picture  Description (+1.16)  ? 

28-XIV-2.  Induction    (+  1.48)       Spatial  relationships    (2) 

29-XIV-3.  President  and  King (+  1.68)       Antithesis 

30-XVI-4.  Enclosed  Boxes (+  1.92)       Spatial  relationships    (1) 

and  (2) 
*31-IX-5.  Three- Word  Sentences. . . .  (+  2.09)  * 

32-IX-2.  Weights    (+  2.49)       Kinesthetic 

*33-IX-l.  Naming  Days (+  2.50)  * 

34-X-3.  Copying  Designs (+  2.57)  Kinaesthetic  and  manipu- 
lation of  spatial  relation- 
ships (1)  and  (2) 

35-XVIII-2.  Paper  Cutting (+2.66)       Manipulation    of    spatial 

relationships  (2) 

36-XVI-5.  Six  Digits  Reversed (+  2.89)       Numerical  and  memory 

*37-IX-4.  Digits  Reversed (  +  2 .  89)  * 

38-XVI-6.  Code  ( +  5 .  70)  Memory  and  manipula- 
tion   of    spatial    relation- 

ships   (1)   and   (2) 

*  Unreliable  because  of  insufficient  data. 
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Dr.  Darsie  also  reports  that  on  the  basis  of  the  teacher's  judg- 
ments Japanese  are  decidedly  superior  to  American  white  children 
in  penmanship,  painting,  and  drawing,  and  inferior  by  about  half 
as  much  in  reading,  composition,  grammar,  and  literature.  Also 
the  Japanese  are  superior  in  "Appreciation  of  Beauty,"  "Perma- 
nence of  Moods,"  "Freedom  from  Vanity,"  and  "Conscientious- 
ness," and  they  are  inferior  in  "Amount  of  Physical  Energy," 
"Self-Confidence,"  "Desire  to  Know,"  "Originality,"  and  "General 
Intelligence." 

A  study  of  Table  LYII  points  to  a  superiority  of  White  to 
Japanese  in  verbal  ability,  a  superiority  of  Japanese  to  White  in 
kinaesthetic  sense  and  probably  also  in  memory  and  manipula- 
tion of  spatial  relationships,  Spatial  2,  of  chapters  vi  and  vii,  but 
not  in  Spatial  1  of  those  chapters.  The  picture  is  not  clear-cut 
and  leaves  much  in  the  way  of  detail  and  certainty  to  be  desired. 

The  recognition  of  the  reality  of  differences  between  races  in 
particularized  mental  traits  cannot  but  affect  individual  and  na- 
tional outlooks  as  to  racial  admixture.  If  a  certain  race  loves 
music  showing  graduations  of  pitch  scarcely  sensed  by  another  or 
if  it  enjoys  drawing  and  design  in  which  occur  contrast  angles 
and  intricate  detail  wasted  on  those  who  love  sinuous  lines  and 
color  harmonies,  there  is  small  wonder  that  the  one  race  does  not 
warm  to  the  culture  of  the  other.  But  the  world  is  small  and  men 
must  live  together.  If  they  can  but  live  in  understanding  of  one 
another,  we  may  then  expect  them  at  least  to  show  respect  and 
tolerance  toward  each  other.  Western  peoples  have  long  thought 
that  races  differ  one  from  another  in  terms  of  superiority.  Though 
this  is  probably  true  with  reference  to  any  mental  trait  which  is 
truly  unitary,  a  more  exact  comparison  of  race  with  race  would 
not  be  expected  to  reveal  a  dead  level  of  difference  in  all  mental 
traits.  It  is  this  detailed  picture  that  is  necessary  before  problems 
of  migration  and  intermarriage  can  be  intelligently  approached. 
There  is  surely  no  natural  law  to  the  effect  that  all  crosses  are 
universally  good,  or  universally  bad. 

Could  the  buzzard  be  crossed  with  the  canary,  we  should  not 
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expect  as  an  outcome  either  an  efficient  scavanger  or  a  song  bird — ■ 
we  might  at  best  get  something  like  a  macaw,  which  is  a  virtueless 
bird  in  both  respects.  Were  a  thrush  crossed  with  a  canary,  would 
the  outcome  be  a  poor  mute  bird  or  one  delivering  such  harmonies 
as  the  ear  has  never  heard?  Unfortunately  we  do  not  know.  If  a 
cross  between  two  human  beings  having  outstanding  talents  re- 
sults in  offspring  with  nondescript  virtues,  it  may  be  looked  upon 
as  disgenic.  But  if  the  outstanding  talents  can  combine  to  make  a 
still  greater  talent,  surely  the  world  has  been  served.  The  mutual 
recognition  by  the  thinking  fraction  of  two  peoples  of  the  truth  in 
the  matter  of  racial  blending,  coupled  with  the  adoption  of  a  policy 
in  conformity  with  it,  should  result  in  an  amity  of  feeling  between 
them  whether  migration  and  intermarriage  follow  or  not.  These 
issues  are  not  minor  and  the  determination  of  the  essential  facts 
would  be  a  fairly  colossal  undertaking,  but  the  principles  and 
methods  to  follow  appear  fairly  within  grasp  and  entirely  straight- 
forward. In  brief,  it  would  be  necessary  to  determine  what  are 
the  functionally  independent  mental  traits;  are  they  acquired  or 
inherited,  and,  if  the  latter,  how  do  they  behave  when  crosses  take 
place?  Any  light  that  a  knowledge  of  independent  mental  traits 
would  bring  to  the  solution  of  racial  eugenic  problems  would  be 
equally  and  more  immediately  serviceable  in  connection  with  indi- 
vidual eugenics  if  the  contracting  parties  were  inclined  to  heed  it. 
Our  present  happy-go-lucky  method  of  choosing  life  partners 
does  result  in  musicians  being  more  likely  to  marry  musicians,  of 
literary  people  being  more  likely  to  marry  literary  people,  etc., 
than  chance  would  give.  Perhaps  this  tendency  has  had  a  cumula- 
tive effect,  and  through  the  operation  of  biological  laws  not  as  yet 
understood  has  been  the  cause  of  such  unitary  mental  traits  as  now 
assuredly  exist.  But  how  inefficient  the  process:  our  great  musi- 
cians do  not  tend  to  marry  equally  great  musicians,  nor  our  great 
literary  men  equally  great  literary  women.  The  regression  toward 
the  mean  in  the  choosing  of  mates  is  perhaps  given  by  a  correla- 
tion in  the  neighborhood  of  .2  or  .3,  and  is  thus  so  great  as  to  be 
very  ineffective.  The  writer  does  not  wish  to  be  understood  to 
advocate  mating  of  like  with  like  at  all  times,  but  only  so  doing 
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when  it  is  established  that  the  cross  gives  much  promise  of  being 
an  individual  of  high  social  value. 

Another  way  in  which  a  knowledge  of  independent  mental 
traits  can  be  of  great  individual  value  is  in  connection  with  the 
laws  of  learning.  Dr.  Blank  was  discouraged  in  his  attempt  to 
teach  appreciation  of  literature  because  he  said  there  was  no  foot- 
hold in  the  subject.  To  illustrate  this  he  cited  that  he  personally 
enjoys  alliteration,  and  for  a  time  thought  he  was  doing  good  in 
the  world  when  he  pointed  out  alliterative  niceties  in  prose  and 
poetry.  However,  a  not  negligible  number  of  his  neophytes  re- 
ceived his  instruction  with  no  sense  of  fulfilment  of  a  felt  need. 
Dr.  Blank  decided  that  if  one  liked  that  sort  of  thing  he  liked  it, 
and  if  he  didn't  then  he  didn't.  What  has  Thorndike's  law  of 
satisfyingness  of  response  to  do  with  this  situation?  Practically 
the  law  is  useless  until  we  know  what  constitutes  satisfaction,  and 
we  will  not  know  that  until  we  know  what  trait  is  being  satisfied 
and  how.  Surely  the  technique  of  accomplishing  satisfaction,  if 
not  in  fact  the  very  basic  principle  itself,  will  change  as  we  pass 
from  verbal  matter  to  spatial  relationships.  Not  only  this  law  but 
every  law  of  learning  so  glibly  memorized  by  students  of  peda- 
gogy demands  verification  and  citation  in  connection  with  the 
separate  fields  of  mental  functioning  before  it  can  hold  a  rich  and 
thoroughly  serviceable  content  for  the  teacher. 

Considerable  recognition  has  been  given  to  independent  mental 
traits  in  vocation,  industry,  and  business.  We  now  need  a  still 
more  careful  study  of  what  these  traits  are  and  of  the  demands  of 
each  of  the  important  vocations  upon  them.  That  there  are  widely 
different  demands  is  axiomatic.  A  certain  acquaintance  of  the 
writer  was  struck  by  the  incompetence  of  salesmen  when  outside 
of  the  selling  fields  known  to  each.  Such  incompetence  is  probably 
no  greater  than  that  of  other  workers,  each  outside  of  his  particu- 
lar field,  but  we  do  not  expect  the  accountant  to  be  a  public 
speaker,  the  machinist  to  be  an  accountant,  or  even  the  boss  of  the 
manufacturing  plant  to  be  an  expert  machinist.  Though  it  is 
probably  true  that  the  verbal  facility  and  comraderie  of  the  sales- 
man are  very  specialized  traits,  nevertheless  they  have  a  less  con- 
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crete  and  measureable  outcome  than  is  the  case  with  numerical, 
musical,  or  manipulative  ability,  and  thus  they  are  not  so  readily 
recognized.  They  are,  however,  fully  credited  in  the  practical  ad- 
ministration of  an  insurance  company,  an  automobile  or  bond  sales 
force,  etc.  We  may  look  to  industry  for  practical  applications  of 
the  independence  of  mental  traits,  and  the  psychologist  will  find 
therein  one  of  the  largest  fields  ready  to  utilize  his  sound  analyses 
of  mental  structure. 

In  the  academic  world  we  are  so  remote  from  economic 
pressure  and  so  little  able  to  measure  the  actual  outcomes  of  our 
instruction  that  we  have  a  poor  field  in  which  to  find  everyday 
illustrations  of  the  independence  of  mental  traits.  "Every  candi- 
date for  the  Doctor's  degree  should  at  least  have  a  good  command 
of  English."  How  common  is  this  remark,  and  how  inadequate 
the  analysis  which  leads  to  it.  Is  not  its  antithesis — "Every  candi- 
date should  at  most  be  able  to  do  one  thing  exceptionally  well" — 
intrinsically  more  reasonable?  Student  A,  known  to  the  writer,  is 
brilliant  in  mathematical  analysis  but  is  nearly  inarticulate  in 
verbal  expression.  His  contributions,  written  presumably  with  the 
help  of  some  other  person,  are  found  in  mathematical  journals. 
This  man  cannot  truly  pass  any  minimal  English  requirements  that 
would  be  proposed.  Perhaps  the  requirements  for  the  doctorate 
should  be  broadened :  "Every  candidate  should  be  able  at  most  to 
do  one  thing  exceptionally  well  or  to  do  a  number  of  things  with 
considerable  merit."  Certainly  the  first  sort  of  individual  should 
be  recognized.  The  independence  of  mental  traits  is  such  that  it  is 
possible  to  go  far  along  one  line  without  commensurate  progress 
along  other  lines,  provided  the  "lines"  are  such  as  tax  fairly  uni- 
tary functions.  If  this  specialized  progress  is  great  intellectually 
and  valuable  socially,  should  it  not  be  recognized  by  our  handclaps, 
Ph.D.  degrees,  and  such  like?  Clearly  we  need  to  know  far  better 
than  we  now  do  what  mental  traits  are  thus  sel  f -conditioned ;  but 
the  mere  recognition  of  the  possibility  of  their  existence  will  pre- 
clude minimal  essentials  which  take  no  notice  of  the  structure  and 
laws  of  mental  life. 

The  determination  of  what  are  the  independent  mental  traits, 
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of  what  are  their  laws  of  functioning,  and  of  what  adult  activities 
demand  them  should,  for  the  sake  of  eugenics,  be  a  prenuptial  con- 
cern; should,  for  efficient  nurture,  be  a  matter  for  continual  note 
in  the  rearing  of  the  individual  from  the  age  when  his  food-getting 
and  other  instinctive  responses  no  longer  circumscribe  his  daily 
life  to  the  close  of  his  formal  education ;  should,  for  social  effi- 
ciency, be  a  determining  influence  in  the  choice  of  a  life  vocation; 
and  should,  in  national  life,  be  an  intimate  issue  in  establishing 
comity  between  nations. 
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